About the job
We are looking for an experienced Staff Software Engineer with a strong background in building software frameworks, LLM eval frameworks and team leadership. You will lead a talented team building a complex product suite using a modern stack. The ideal candidate is a hands-on technical leader who can drive architectural decisions, mentor engineers, and collaborate closely with product management to deliver a product that solves our customers' most challenging modernization validations problems, ensuring that new applications have the same functionality and performance as their legacy counterparts.
Responsibilities
Provide technical leadership and mentorship to a team of engineers, fostering a culture of innovation, quality, and continuous improvement
Drive the architectural vision and long-term technical roadmap for the Validation and Eval product suite, ensuring it is scalable, reliable, and performant
Collaborate closely with Product Managers and other stakeholders to define product features and translate business requirements into robust technical designs
Lead the design and implementation of complex, mission-critical components of our Validation and Eval tools
Champion and enforce engineering best practices through design reviews, code reviews, and by setting a high standard for quality and operational excellence
Act as a hands-on leader, guiding the team through complex technical challenges and contributing to the codebase where necessary
Qualifications
Minimum
8+ years of commercial software development experience with at least one JVM language such as Java, preferably using the Spring ecosystem and paired with strong Python experience
2+ years of experience leading, coaching, and mentoring a team of software engineers to achieve high-impact results
Solid experience in software architecture and development
Familiarity with evaluation frameworks (such as DeepEval, Ragas, and Promptfoo) and harnesses, alongside benchmark datasets, scoring/grading approaches, and LLM-as-a-judge methodologies
Experience in application/database modernization with proven ability to design and implement frameworks that ensure database state equivalence across different implementations
Must understand change data capture, event-driven database interception (MongoDB listeners, RDBMS triggers), and state comparison algorithms with pattern-based exclusions
Extensive experience with relational and document data modeling and hands-on experience with at least one SQL database (Postgres, MySQL, etc) and at least one document database (e.g. MongoDB)
Good understanding of algorithms, data structures and their time and space complexity
Excellent verbal and written communication skills
Preferred
No preferred qualifications listed.