Senior Software Engineer – Spark
Speedata is modernizing analytics infrastructure with the first purpose-built ASIC processor, the Analytics Processing Unit (APU), for analytics and AI data workloads. Delivering up to 100x faster Apache Spark performance while cutting infrastructure TCO by 90%, the APU executes analytics operations directly in silicon with seamless integration and no code changes.
We’re seeking an outstanding Senior SW Engineer to join our team and help us develop our data frameworks integrations. This is a rare opportunity to influence the future of data processing.
Responsibilities:
Develop our Spark plugin and integrations
Develop in Scala and Java
Contribute to open-source projects
Develop in Python
Design advanced algorithms of processing and optimizing query plans
Define our query abstraction layer
Collaborate with other software teams to optimize software and hardware integration for maximum performance
Requirements:
BSc or equivalent or higher degree in Computer Science, Computer Engineering, or Electrical Engineering.
8+ years of experience in software development with a strong focus on data engineering
Strong proficiency in Java and Scala, Python - an advantage
Experience with Apache Spark / other big data frameworks
Excellent communication skills and ability to explain complex technical concepts to non-technical stakeholders
Advantages
Experience with database systems and SQL
Back to Career page
Apply
BSc or equivalent or higher degree in Computer Science, Computer Engineering, or Electrical Engineering.
Strong proficiency in Java and Scala, Python - an advantage
Experience with Apache Spark / other big data frameworks
Excellent communication skills and ability to explain complex technical concepts to non-technical stakeholders
