Data Engineer
At Sparta, our culture is a way of life. We celebrate initiative, embrace challenges, and foster innovation. As a remote company, we help employees thrive and build strong, meaningful connections.
Hi, we’re Sparta Commodities!
We are a Swiss, VC-backed scaleup with a global reach. Our mission is to digitise the commodity trading market and and become the leading platform in all commodities verticals by enabling traders to make better decisions, faster. This is an exciting time to join us- we've already gained significant market traction and are rapidly growing.
Sparta currently has a fantastic opportunity to join our growing Data team. This is a great career opportunity for an experienced and delivery-focused Data Engineer to play a key role in refining and optimising how data from varied sources is ingested, processed, and cleansed.
We are a fully remote company with a modern tech stack, and we strive for fast deployments to support the rapid growth we are experiencing. As a data business, your role will be key to our continued growth, development and success.
Reporting to our Head of Data, you will work alongside our Data and Development teams to refine and optimise our current data ingestion, ETL, and cleansing models.
You'll be responsible for building new data ingestion pipelines using Python and SQL all running on AWS; data wrangling, management, and standardisation; data quality analysis and cleansing; and applying best practices in software development.
We plan to utilise our data to build machine learning models and uncover hidden insights, but first, we must build a good foundation to ensure our long-term success. You will have a chance to influence our cloud data infrastructure design, take ownership of end-to-end data projects, and liaise with other parts of the business to ensure we can leverage our data to create value for our clients. There is so much to build here and we are looking for someone with the passion and experience to help us to do this.
We're looking for:
Prior experience as a Data Engineer or Software Engineer, building ETL/ELT pipelines from scratch.
Experience with monitoring and alerting of data ingestion jobs.
Someone who can work as an individual contributor but also enjoy leading projects and productionising solutions for complex problems.
Someone who thrives in a fast-paced, scale-up environment, comfortable with ambiguity and eager to take ownership and act on their own initiative. We want you to contribute ideas, improve the way we do things, and determine the best way to solve problems.
An effective and confident communication, able to engage across the business and collaborate effectively in a remote-first company with a diverse international workforce.
Technical Requirements:
- Extensive experience with Python for data ingestion, transformation, and loading processes.
- Practical experience in AWS cloud services.
- Good understanding of relational databases.
- Proficient in monitoring and alerting for data ingestion pipelines using tools such as Datadog, focussing on ensuring high availability and reliability.
- Proficiency in using Unix / Linux at the command line to perform software development and maintenance.
- Proven experience in version control, CI/CD, unit test, integration test, functional test, and writing documentation.
- Practical experience in modern software engineering techniques and best practices.
Bonus Points:
- Knowledge of NoSQL databases.
- Familiarity with DevOps/MLOps practices, including automation, infrastructure as code, and CI/CD pipelines for machine learning workflows.
- Experience in real-time/streaming data ETL, leveraging technologies like Apache Kafka or AWS Kinesis for high-volume data processing.
- Working knowledge of Java, with the ability to contribute to Java-based projects or collaborate in multi-language environments.
- Experience in the trading/fintech industry.
What’s the culture like at Sparta?
At Sparta, our culture is not just a set of values written on a wall—it's a way of life. We embrace a dynamic environment where initiative is celebrated, challenges are met head-on, and innovation thrives.
We're building an environment where our employees thrive and excel in their work. Our aim is for every member of our team to take pride in their contributions. You'll collaborate with like-minded individuals who are passionate about our mission and deeply committed to crafting outstanding products and achieving success for our customers.
We operate remotely, understanding that a thriving, profitable company isn't just about being in the same location. We build our relationships through effective remote work methods and carefully planned in-person meet-ups.
What we offer:
- Fully remote working, with occasional travel to a central hub for collaborative meetings and team gatherings.
- Attractive company stock option plan.
- Regular team and company meetups.
- A real performance-led business with support for you to achieve your career goals.
- Private Medical Insurance.
- Life Insurance of 4 times your annual salary (for UK-based employees).
- Access to the optimal gear suited for your position.
- Department
- Data
- Role
- Data Engineer
- Locations
- London
- Remote status
- Fully Remote
- Employment type
- Full-time
About Sparta Commodities
For traders who want to anticipate future pricing trends and seize opportunities, Sparta provides real-time, actionable market intelligence. Sparta is built by traders for traders and sets itself apart from data analytics providers by giving you forward-looking, actionable insights.
Data Engineer
At Sparta, our culture is a way of life. We celebrate initiative, embrace challenges, and foster innovation. As a remote company, we help employees thrive and build strong, meaningful connections.
Loading application form