Remote Job
Senior Software Engineer (Query Performance, Java/Scala)
XONAI- fullTime
- Posted : 11 months ago
Organizations scaling data and AI-driven products face hurdles to keep up with business growth, as scaling hardware allocation increases cloud spending proportionally and pushes engineering efforts towards optimizing infrastructure rather than delivering innovation.
We started XONAI with the mission to unlock the power of hardware and build the best-in-class solution for helping organizations to accelerate time to value and reduce data infrastructure operational costs. Our engine can seamlessly reduce cloud costs of Spark jobs deployed at enterprise scale, we now want to scale it towards AI.
We raised a total $3.5M in seed funding and we are scaling our amazing team to bring world-class support to our customers and expand our novel solution to realize the universal compute fabric. Find out more about us on our blog.
About the Role
This role working with the internals of distributed data processing systems at query plan level to optimise query performance. You will collaborate with the founding team to expand the integration of our data processing acceleration technology with Apache Spark and drive new optimizations and broader API coverage.
Requirements
- Strong Java, C++ or Scala programming skills.
- A solid understanding of distributed systems (Apache Spark, Hadoop, Presto, Flink) or SQL database engines.
- Experience with JVM profiling and debugging tools.
- Strong grasp of computer science fundamentals such as algorithms and data structures.
- Ability to write, test and deploy production code driven by modern software engineering practices.
What you will be doing:
- Accelerate Apache Spark data processing performance by offloading query compilation to our domain-specific compiler.
- Design and implement new data processing optimizations at query plan level.
- Optimize internal processes that contribute to query time (I/O, serialization, data sources).
- Diligently test new optimizations and assess their impact on benchmarks.
- Work with the internals of leading open-source software for big data analytics as part of our core product for the cloud.
- Collaborate with team members to drive new innovations on big data processing lying at the intersection of big data and compiler technologies.
Nice-To-Haves:
- Experience with query processing and optimization.
- Experience with container orchestration (Docker, Kubernetes, etc).
- Understanding of data storage formats and processing internals (Parquet, Delta, ORC, Avro, etc).
- Hands-on experience with public cloud platforms (AWS, Google Cloud Platform, Azure).
- Entrepreneurial spirit and previous experience in early stage start-ups.
- Exposure to Data Science and Machine Learning environments.
- Critical thinking and ability to work independently without direct supervision.
- Strong analytical and excellent problem solving skills.
Benefits
- Dedicated Team. Work with an amazing team exploring compiler and big data technologies to build the next-generation solution for data infrastructure at scale.
- Flexible Location. Work where you feel most productive, either fully remote or at any coworking office space of your convenience.
- Competitive Compensation. We offer strong compensation upfront, aligned with a starting equity package, progressive compensation plan and employee referral program.
- Amazing Benefits. In order to attract and retain the best talent, we offer medical insurance, a dental, audio and visual cash plan, as well as a company pension. Enjoy flexible work hours, paid time off (vacation, sick & public holidays) and our unlimited vacation policy.
