Machine Learning Applications Engineer Job at Etched, Cupertino, CA

WjFXaDhMeXd1aURLaGo3VVd2Mis2UDZIWFE9PQ==
  • Etched
  • Cupertino, CA

Job Description

Machine Learning Applications Engineer Etched is building the hardware for superintelligence. GPUs and TPUs are flexible AI chips that can run many kinds of models: CNNs, RNNs, LSTMs, and more. But today, almost all AI workloads, from ChatGPT to self-driving cars, are done on one model architecture: transformers. Using flexible AI chips for transformers is very inefficient: Etched is building a single-purpose chip exclusively for transformer inference. We only support transformers, but in exchange our chips have an order of magnitude more throughput and lower latency than an H100. With Etched, you can build products that would be impossible with GPUs, like tree-of-thought agents and ultra-low-latency audio chat bots. Etched is looking for exceptional ML applications engineers to join our team. Building model-specific silicon unlocks new capabilities (e.g. tree search and super low latency applications) - an ideal candidate for this role will help develop products and work with customers who are developing products that aren’t possible without our hardware. This role will report to the VP of Software. Responsibilities: Provide input for engineers designing our integrations with current transformer-specific inference libraries, like TensorRT-LLM, TransformerEngine, Hugging Face TGI, and vLLM. Help profile and understand where latency comes from in modern LLM serving stacks Help customers create products that leverage the unique capabilities of model-specific silicon Requirements: Deeply creative and able to think from first principles Good understanding of LLM architecture and how to use them to build applications 1+ year(s) of work experience at a cloud provider, AI company, or LLM startup Proficient in Python Breadth of knowledge about current research on large language models Desired qualifications: Experience with semiconductor design and development Experience with deep learning frameworks (such as PyTorch, Tensorflow) Experience with deep learning runtimes (such as ONNX Runtime, TensorRT,...) Experience with at least one of TensorRT, TensorRT-LLM, Transformer Engine, or vLLM Experience training, tuning and deploying ML models for CV (ResNet,..), NLP (BERT, GPT), and/or Recommendation Systems (DLRM) Benefits: Competitive salary and equity package Full medical, dental, and vision packages, with 100% of premium covered Work with world-class people and state-of-the-art AIs everyday Etched is committed to fair and equitable compensation practices. Compensation is determined based on your qualifications and experience. Compensation packages also include generous equity in Etched. We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or other legally protected statuses. #J-18808-Ljbffr

Job Tags

Work experience placement, Flexible hours,

Similar Jobs

The AES Corporation

Legal Counsel Job at The AES Corporation

 ...committed to meeting the Paris Agreements goals by 2050. Legal Counsel Clean Energy Provide advice and counsel to...  ...relevant legal experience, preferably at a major law firm or in?house. R enewable energy experience; wind energy, battery storage or... 

Metropolitan Market

Meat/Seafood Assistant Team Leader Job at Metropolitan Market

 ...THE ROLE As a key member of the Meat/Seafood department leadership team, the Meat/Seafood Assistant Team Leader has a breadth of responsibilities spanning from team member development and sales generation, to product management and merchandising. In this role, you... 

Novant Health

Registered Nurse, Pelvic Specialty Job at Novant Health

What We Offer: The Registered Nurse serves as a leader of the healthcare team at Novant Health by establishing an authentic personalized...  ...nursing required. If your RN nursing license has been inactive, retired or lapsed for five years or more and you have not been licensed...