Software Engineer - Edge AI Systems

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more

The role

We are seeking an experienced Software Engineer to join a newly-formed team focused on developing and deploying advanced AI systems to the tactical edge. This role involves training, evaluating, and deploying LLM agents to edge hardware for interfacing with sensors, effectors, and drone systems. This project is in support of multiple customers in the defense sector that are looking for untethered AI solutions that can be rapidly deployed downrange on hardware with limited capabilities.

As a part of this team, you will build and deploy specialized models and agents that can run on tactical edge hardware, working alongside other experts in AI, LLMs, and systems to shape solutions that redefine complex tactical defense scenarios. Core Responsibilities Train and fine-tune edge-capable LLMs for tactical defense applications Optimize model performance for various edge hardware (GPU, CPU, and specialized accelerator) platforms Design and implement multi-agent systems for various mission scenarios Interface LLM agents with sensors, effectors, and drone systems Benchmark and evaluate agent capabilities, performance, and reliability Engineer scalable, reliable, and fail-safe systems capable of functioning in high-stakes environments What We Value Proven experience in AI model development, training, and fine-tuning Experience building LLM agent systems using direct LLM API calls, or frameworks such as LangChain Experience optimizing AI models and runtime performance for edge hardware Familiarity with edge AI optimization tools including Ollama, Mojo, TVM, TF Lite, and vLLM Experience working in the defense sector, especially with weapon and UxV systems, is highly desirable Ability to manage complexity, optimize for performance, and think critically under pressure Experience deploying and maintaining robust production systems What We Require 5+ years of professional software development experience 2+ years of experience contributing to the system design or architecture (architecture, design patterns, reliability and scaling) of new and existing systems Experience building and deploying LLMs and LLM agents using modern frameworks such as PyTorch, HuggingFace Transformers, LangChain, and vLLM Strong proficiency in Rust, Python, or C++ Bachelor's/Master's/PhD in Computer Science, Physics, Mathematics, or related fields Active US Security clearance or eligibility and willingness to obtain a US Security clearance Salary The salary range for this position is estimated to be $145,000 - $200,000/year.