Cupertino, California, United States
Summary
Posted: Sep 5, 2024
Weekly Hours: 40
The AIML – On-Device Machine Learning group is responsible for the creation of amazing on-device ML experiences. The team builds foundational machine learning frameworks and tools to optimize large language/vision/multi-modal models that power on-device ML features across Apple products and services. The group is looking for a senior software engineer to help define and implement features that accelerate and compress large state of the art (SoTA) models (e.g., LLMs) in our on-device inference stack. This is a unique opportunity to work on exciting new technologies and contribute to Apple’s ecosystem, with a commitment to privacy and user experience impacting millions of users worldwide. Are you someone who can write high-quality, well-tested code and collaborate cross-functionally with partner Hardware, Software, Machine Learning, and Research teams across the company? Do you have any experience building Machine Learning compilers/runtimes/kernels/optimization tools? If so, come join us and be a part of the team that is helping Machine Learning developers innovate and ship enriching experiences on Apple devices!
Other Posts You May Be Interested In
- Part-Time Yelp Spam Comment Remover (Multiple Locations)
- Operations Lifecycle Program Manager
- Health Sensing HW – Electrical Engineer
- Software Quality Engineer, Retail Engineering, Early Career
- AIML – Sr. ML Operations Engineer, BIG
- Software Engineer, Proactive UI Intelligence
- US – Specialist: Full-Time, Part-Time, and Part-Time Temporary
- Global Supply Analyst
- Full Stack Software Engineer – Internal Tools
- Machine Learning Algorithm Engineer
- Threat Intelligence Analyst, SEAR
- Engineering Program Manager, CoreOS
- iCloud Support Engineering Readiness Project Manager
- Data Platform SRE
- NPI Operations Program Manager
- AIML – ML Engineer, MLR
- Engineering Program Manager, CoreOS
- Operating System Build Quality Engineer
- HPC-Focused IT DevOps Engineer
- Firmware Engineer
Description
This role sits at the intersection of software engineering and ML engineering. As a member of this team, the successful candidate will: – Build features for our on-device inference stack to support the most relevant accuracy preserving, general purpose techniques that empower model developers to compress and accelerate SoTA models (e.g., LLMs) in apps – This includes building Machine Learning compilers, runtimes, execution kernels, optimizations on ML models, tooling for debugging/visualization of ML models, etc. – Convert models from a high-level ML framework to a target device (CPU, GPU, Neural Engine) for optimal functional accuracy and performance – Write unit and system integration tests to ensure functional correctness and avoid performance regressions – Diagnose performance bottlenecks and work with HW & SW Arch teams to co-design solutions that further improve latency, power, and memory footprint of neural network workloads – Analyze impact of model optimization (compression/quantization etc) on model quality by partnering with modeling and adaptation teams across diverse product use cases.
Minimum Qualifications
- Bachelors/Masters/PhD in Computer Science or related fields.
- At least 4 years of experience in Machine Learning (ML) Engineering, System Software Engineering, or related fields.
- Strong proficiency in C/C++ and Python.
- Familiarity with ML fundamentals.
- Familiarity with developing or using ML Frameworks.
Preferred Qualifications
- Experience with PyTorch/JAX Machine Learning frameworks.
- Experience with Machine Learning model inference (serving) is a big plus.
- Experience with MLIR / LLVM compiler technologies is a big plus.
- Experience with on-device machine learning or system software design is a big plus.
- Experience with Swift is a plus.
- Excellent communication skills.
- Passion for designing Software systems, APIs, and extensible products.
Pay & Benefits
- At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $143,100 and $264,200, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation.