Ax The Soofi-Team, :, Benedikt Droste, David Fitzek, Ruben H\"arle, Lukas Helff, Maximilian Idahl, Alex Jude, Abbas Goher Khan, Maurice Kraus, Timm Ruland, Richard Rutmann, Sebastian Sztwiertnia, Markus Frey, Daniil Gurgurov, Jan Pfister, Tom R\"ohr, Sebastian von Rohrscheidt, J\"org Bienert, Nicolas Flores-Herr, Simon Gottschalk, Andreas Hotho, Kristian Kersting, Joachim K\"ohler, Alexander L\"oser, Wolfgang Nejdl, Simon Ostermann, Jan Plogsties, Patrick Putzky, Mehdi Ali, Michael Fromm, Max L\"ubbering 16d ago

A Sovereign, Open-Source Foundation Model for German and English

Soofi S 30B-A3B: open-source MoE hybrid Mamba Transformer foundation model for German and English, 3B active parameters per token, optimized for long-context deployment.

Ax Federico L. Perlino, Oliver Hamelijnck, Adam M. Johansen, Theodoros Damoulas 16d ago

Deep Gaussian Processes on Directed Acyclic Graphs

ArXiv paper on deep Gaussian processes over DAGs for modeling compositions of partially-observed functions in causal and engineering systems.