Overview
Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI.
The R&D ML team is responsible for training, testing and optimizing a set of models and pipelines used across the whole stack. As a model architecture lead for retrieval and reranking, you will lead the design and post-training strategies of our next generations of in-house models that will be integrated in our product. While our current generation of models are text only, we plan to add multi modality in the near future.
This is an outstanding opportunity to lead our effort and contribute to shipping the upcoming generation of Elastic’s models, which will then be served to our broad userbase.
What You Will Be Doing
* Strategic research & technical roadmap definition: identify promising new technologies for text-only and multi-modal models, look into post-training methodologies relevant for retrieval and re-ranking, and champion solutions that will fit best in Elastic.
* Tooling: improve our infrastructure and help scale to accommodate larger models: provide expert guidance on distributing data preparation, training and testing on multiple GPUs, help design, improve and write specs for our compute infrastructure
* Model variants exploration: investigate applying fine-tuning, quantization, distillation and other techniques to existing or upcoming models.
* Technical leadership: foster a culture of innovation and rigorous experimentation, coordinate knowledge sharing within the team; act as a senior technical authority and go-to expert for the modeling, training and testing challenges; mentor more junior members of the team helping them develop their skills and knowledge
* Communication: interact with various leads across the organization, communicate sophisticated concepts to high profile stakeholders, adjust and iterate on the roadmap according to internal and external inputs.
What You Bring
* Excellent comprehension of the industrial and academic state of the art on xLMs, more specifically in retrieval and reranking techniques
* Extensive professional experience in designing, training, and debugging various model architectures as well testing and implementing post-training strategies; proven track record of assessing, proposing and integrating frontier techniques to large scale products.
* 6+ years of professional software development experience in Python (pytorch).
* Experience with large-scale model training (between 0.1 and 7B parameters), distributed training, and model optimization techniques (e.g., quantization, pruning, efficient attention mechanisms).
* Excellent communication skills and gentle approach to leadership
* Strong attention to detail and highly organized
Additional Information
* Competitive pay based on the work you do here and not your previous salary
* Health coverage for you and your family in many locations
* Ability to craft your calendar with flexible locations and schedules for many roles
* Generous number of vacation days each year
* Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service
* Up to 40 hours each year to use toward volunteer projects you love
* Embracing parenthood with minimum of 16 weeks of parental leave
Elastic is an equal opportunity employer and is committed to creating an inclusive culture that celebrates different perspectives, experiences, and backgrounds. Qualified applicants will receive consideration for employment without regard to race, ethnicity, color, religion, sex, pregnancy, sexual orientation, gender identity or perception, national origin, age, marital status, protected veteran status, disability status, or any other basis protected by law. We welcome individuals with disabilities and strive to create an accessible experience; accommodations can be requested at candidate_accessibility@elastic.co. We will respond within 24 business hours of submission. Applicants have rights under applicable employment laws; posters are available for review, including FMLA, EEOC, EPPA, and privacy notices. For details, please see Elastic’s Privacy Statement.
#J-18808-Ljbffr