Our mission is to build the next generation of AI: ubiquitous, interactive intelligence that runs wherever you are. Today, not even the best models can continuously process and reason over a year-long stream of audio, video and text—1B text tokens, 10B audio tokens and 1T video tokens—let alone do this on-device.
We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models.Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.
We're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.
The Role
• Conduct groundbreaking research in neural network architecture design to advance the state-of-the-art (SOTA) in alternative architectures (e.g., state space models, efficient Transformers, hybrid architectures).
• Design novel architectures that improve model quality, inference efficiency, and adaptability across diverse deployment environments, from cloud to on-device.
• Explore and develop capabilities such as statefulness, long-range memory, and innovative conditioning mechanisms for enhancing model expressiveness and generalization.
• Investigate how architectural decisions impact model trade-offs, including scalability, robustness, latency, and energy efficiency.
• Develop new frameworks and tools to evaluate architectural innovations, benchmarking performance across research and production settings.
• Collaborate with cross-functional teams to translate architectural research into scalable and impactful systems for real-world applications.
What We’re Looking For
• Deep expertise in architecture design, with experience in researching or deploying advanced architectures (e.g., state space models, transformers, RNN variants, CNN variants).
• Strong understanding of how architectures interact with system constraints, including deployment in cloud environments or on-device.
• Proficiency in designing architectures that balance quality, efficiency, and adaptability across different use cases and modalities (e.g., vision, audio, text).
• Familiarity with generative modeling paradigms like autoregressive and diffusion models, and designing capabilities such as statefulness and conditioning in deep learning models.
• A proven research track record in top-tier ML/AI venues (e.g., NeurIPS, ICML, ICLR, CVPR) or demonstrable contributions to state-of-the-art architectures.
• Exceptional analytical and problem-solving skills, with a focus on experimentation and iterative refinement.
• Strong programming skills in deep learning frameworks such as PyTorch or TensorFlow, and experience with profiling tools for understanding model performance.
Nice-to-Haves
• Prior research or publications in state space models, efficient Transformers or other alternative architectures.
• Research or practical experience in designing architectures for multi-modal systems.
• Early-stage startup experience or a track record of rapid innovation in R&D environments.
Our culture
We’re an in-person team based out of San Francisco. We love being in the office, hanging out together and learning from each other everyday.
We ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we don’t sacrifice quality and design along the way.
We support each other. We have an open and inclusive culture that’s focused on giving everyone the resources they need to succeed.
Our perks
Lunch, dinner and snacks at the office.
Fully covered medical, dental, and vision insurance for employees.
401(k).
️ Relocation and immigration support.
Your own personal Yoshi.
#J-18808-LjbffrJoin to apply for the Software Engineer - Storage role at MotherDuck10 hours ago Be among the first... ...at MotherDuck by 2xGet notified about new Software Engineer jobs in San Francisco,... ...0 6 days agoSoftware Engineer(s) - New Grad (Fall 2025 Graduation) Were unlocking...
...Production Manager - Chemical Process Dayton, Ohio area Excellent benefits and bonus potential! Do you want to make an impact... ...shift operation. As the Production Manager, you will report to the Plant Manager and will have Production Supervisors reporting to you....
Leading drayage company is seeking a driven and strategic Talent Acquisition Specialist with industry experience for a hybrid position located in Manhattan, New York. This role involves identifying, attracting, and hiring top talent across multiple departments, while working...
...Job Description Lead. Inspire. Excel. Delta Dental of Missouri is looking for a dynamic... ...drive team success and create a positive work environment. In this role, you'll track performance... ...as a hybrid role working from both home and in-office environments. Any at-home...
...industry? Schedule : Looking for more home time? 92% of our drivers are home daily! Tuesday Saturday Start time vary between 8PM 2AM 10-12 hours a day, 50-55 hours per week Our Delivery Drivers start at $38.11 per hour PLUS overtime after 40! **...