Celestial AI is combining the strengths of photonics, mixed signal ASICs, and advanced packaging to enable a disruptive and sustainable improvement in AI compute performance. The novel Celestial AI architecture unlocks more scalable performance than traditional, digital-only, data parallel designs.

As Software Engineer, AI, you will develop software to serve predictions from trained neural networks running on Celestial AI’s ML accelerator. You will be an active member of the team working with open source software for deep learning; build robust software that can be deployed in production server or cloud settings; work with team leads to prioritize features and capabilities; load-balance asynchronous requests across available resources; optimize inference throughput under latency constraints; and integrate the latest open source technology for mission critical ML model serving.

ESSENTIAL DUTIES AND RESPONSIBILITIES:

• Develop production-grade HW-accelerated ML inference software in C++ and Python under Linux environment.
• Build software and tools for effective deployment of trained ML models.
• Collaborate with deep learning professionals and ML architects to develop robust ML software for computer vision, NLP, and recommendation systems.
• Participate in the development of API libraries, and backend services.
• Take part in the design, development, and testing of various user level software.
• Solve problems during development, testing, and provide technical support.
• Keep code base and design up to date with the latest trend and technology.
• Be active in code review and discussions to learn, share knowledge, and improve code quality
• Responsible for the architecture of software solutions, determining current limitations and compatibilities between subsystems, the selection of new concepts and methodology, and the development of major routines, libraries and utilities.
• Creating new feature and performance improvements.
• Preparation of technical requirements and software design specifications.
• Instilling best practices for software development and documentation, making sure designs meet requirements, and delivering high quality software on tight schedules.

QUALIFICATIONS AND EXPERIENCE

• Master’s degree or equivalent experience in Computer Science, computer architecture, or related field
• 3+ years of C/C++ and Python programming and software design skills, including debugging, performance analysis, and test design.
• Knowledge of distributed systems programming
• Excellent troubleshooting abilities spanning multiple software layers (user-level, kernel-level)
• Experience with deep learning algorithms and frameworks such as PyTorch, TensorFlow, TensorRT, and ONNX Runtime
• Working experience with open source software - use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.
• Experience building and deploying cloud services using HTTP REST, gRPC, protobuf, JSON and related technologies
• Knowledge of container technologies and orchestrators, such as Docker and Kubernetes
• Knowledge of GPU programming such as OpenCL or CUDA
• Ability to work in a fast-paced, agile team environment