Distributed Software Engineer
Cerebras
Cerebras Systems has pioneered a groundbreaking chip and system that revolutionizes deep learning applications. Our system empowers ML researchers to achieve unprecedented speeds in training and inference workloads, propelling AI innovation to new horizons.
Condor Galaxy 1 (CG-1), a supercomputer set to revolutionize the world of artificial intelligence. With an astounding processing power of 4 ExaFLOPs, 54 million cores, and a cutting-edge 64-node architecture, the CG-1 is the first milestone of a larger project that will redefine the possibilities of AI.
The successful completion and deployment of the CG-1, the first of nine powerful supercomputers, is a significant achievement for Cerebras. As we enter phase 2 of the project with CG2, we are taking a bold step towards creating a network of interconnected supercomputers that will collectively deliver a mind-boggling 36 ExaFLOPs of AI compute power upon completion.
The Role
Cerebras Systems is a pioneer in large-scale AI Supercomputers. These multi-exaflop supercomputers are deployed in some of the biggest datacenters. These supercomputers are built using our Wafer-Scale Cluster technology - a cluster of several Wafer Scale Engine (WSE) chips. The Cluster engineering team is responsible for delivering software that are all-things related to cluster.
Responsibilities
- Automate bare-metal configuration of networking, OS, and application software in large clusters of Cerebras WSE, servers, and switches
- Additional push button workflows for cluster upgrades, downgrades, and security patching with key metrics to minimize downtime on clusters
- An orchestration and scheduler system for resource allocation, job submission & placements for a multi-user environment on a cluster
- Seamless support for both on-premise and cloud mode deployment and operations
- A robust system for monitoring, detecting and handling failures for a variety of resources on the clusters (including High Availability of clusters)
- Broad cluster and job monitoring and visualization capabilities, along with alerting systems
- User facing tools to monitor the status of jobs and collect metrics
- Administrator facing tools to manage and operate large clusters
Skills and Qualifications
- Strong track record of software architecture, system design and development for over 6 years or more
- Strong track record of development in distributed cluster environment.
- Strong understanding of Kubernetes (K8s) software ecosystem, Prometheus and Grafana
- Strong development skills in GoLang, Python, bash
- Strong debugging skills with distributed systems
- Strong skill to develop tests for the new features and regress old features
Why Join Cerebras
People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
- Build a breakthrough AI platform beyond the constraints of the GPU
- Publish and open source their cutting-edge AI research
- Work on one of the fastest AI supercomputers in the world
- Enjoy job stability with startup vitality
- Our simple, non-corporate work culture that respects individual beliefs
Read our blog: Five Reasons to Join Cerebras in 2024.
Apply today and become part of the forefront of groundbreaking advancements in AI.
Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.
This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.