⬅️  To Main Apache Spark jobs

Create flexible and precise queries that fit your needs exactly. Example: React.js, -USA  × Laravel, Vue.js, -Contract  × will get you jobs that are (React.js and not in USA) or (Laravel and Vue.js and not Contract/Freelance).

You can mix and match any tags, negations and groups in any order. And don't worry about typos – the search is fuzzy.

Dismiss

Gauntlet US
Gauntlet leads the field in quantitative research and optimization of DeFi economics. We manage market risk, optimize growth, and ensure economic safety for protocols facilitating most spot trading, borrowing, and lending activity across all of DeFi, protecting and optimizing the largest protocols and networks in the industry. As of January 2025, Gauntlet manages risk and incentives covering over $35 billion in customer TVL. Gauntlet continually publishes cutting-edge research that informs our risk models, alerts, and analysis, and is among the most cited institution — including academic institutions — in terms of peer-reviewed papers addressing DeFi as a subject. We’re a Series B company with around 75 employees, operating remote-first with a home base in New York City. Gauntlet’s mission is to drive adoption and understanding in the financial systems of the future . Building with decentralized systems creates novel challenges f

Gauntlet leads the field in quantitative research and optimization of DeFi economics. We manage market risk, optimize growth, and ensure economic safety for protocols facilitating most spot trading, borrowing, and lending activity across all of DeFi, protecting and optimizing the largest protocols and networks in the industry. As of January 2025, Gauntlet manages risk and incentives covering over $35 billion in customer TVL.

Gauntlet continually publishes cutting-edge research that informs our risk models, alerts, and analysis, and is among the most cited institution — including academic institutions — in terms of peer-reviewed papers addressing DeFi as a subject. We’re a Series B company with around 75 employees, operating remote-first with a home base in New York City.

Gauntlet’s mission is to drive adoption and understanding in the financial systems of the future. Building with decentralized systems creates novel challenges for mechanism designers, smart contract developers, and end-users of financial products, which are not seen in traditional software development and investing contexts. Gauntlet is dedicated to enhancing our industry’s understanding of this new domain and revealing how to safely navigate the true bleeding edge of 21st-century financial innovation.

We are looking for engineers for a few projects! See below:

Pivot/Courier Services

We’re developing an algorithmic trading platform to optimize strategies Gauntlet oversees on-chain to capture opportunities across DeFi. We’re looking for a product-focused systems generalist to work with users to define requirements and build the system’s required components!

Data & Models

We develop & own the services that power Gauntlet’s platform, including all our model capture, infrastructure, deployments & tools to support & scale our systems!

Responsibilities

  • Design, build, and maintain robust, scalable systems for data from DeFi protocols, blockchain networks, and various other data sources
  • Contribute to making our platform world-class
  • Collaborate with stakeholders to understand their system requirements and provide the necessary support to help their productivity.
  • Implement quality control measures to ensure system integrity and quality
  • Actively participate in code and design reviews, providing constructive feedback to peers and maintaining high coding standards
  • Keep up-to-date with the latest industry trends, technologies, and best practices to ensure the continuous improvement of the platform
  • Contribute to the creation of technical documentation and user guides
  • Troubleshoot, diagnose, and resolve software defects, ensuring optimal system performance and reliability

Qualifications

  • At least 4 years of professional development experience. More is better but we’re flexible
  • Experience with building backend systems.
  • Experience developing production-quality software in high-performance languages. We currently use Python and Typescript but are open to exceptional language agnostic candidates.
  • Experience with dynamic isolated environments and operational alerting
  • Experience with distributed data processing frameworks and related technologies such as Kafka, Spark, Flink, etc.
  • Ability to quickly internalize abstract concepts in new domains, coupled with strong problem-solving skills and attention to detail.
  • Ability to work independently and within a team, manage multiple projects, and meet deadlines.
  • Strong communication skills and the ability to work collaboratively in a distributed team environment
  • Interests or passion for DeFi and the broader crypto ecosystem, with a willingness to immerse oneself in the space.

Bonus Points

  • Experience working in the crypto industry is a plus but is not required.
  • Background in working with complex data sets in data-rich environments
  • Experience with languages and tooling related to complex streaming problems
  • Familiarity with cloud solutions like Google Cloud Platform or AWS

Benefits and Perks

  • Remote first - work from anywhere in the US & CAN!
  • Competitive packages with the added opportunity for incentive-based compensation
  • Regular in-person company retreats and cross-country “office visit” perk
  • 100% paid medical, dental and vision premiums for employees
  • Laptop provided
  • $1,600 WFH stipend upon joining
  • $100 per month reimbursement for fitness-related expenses
  • Monthly reimbursement for home internet, phone, and cellular data
  • Unlimited vacation policy
  • 100% paid parental leave of 12 weeks
  • Fertility benefits

Please note at this time our hiring is reserved for potential employees who are able to work within the contiguous United States and Canada. Should you need alternative accommodations, please note that in your application.

The national pay range for this role is $160,000 - $200,000 plus additional On Target Earnings potential by level and equity in the company. Our salary ranges are based on paying competitively for a company of our size and industry, and are one part of many compensation, benefits and other reward opportunities we provide. Individual pay rate decisions are based on a number of factors, including qualifications for the role, experience level, skill set, and balancing internal equity relative to peers at the company.

Permalink

Nethermind Remote
What are we all about? We are a team of builders and researchers on a mission to empower enterprises and developers worldwide to access and build on decentralized systems. Our expertise covers several domains: Ethereum and Starknet protocol engineering, layer-2, AI, cryptography research, protocol research, decentralized finance (DeFi), security auditing, formal verification, real-time monitoring, smart contract development, and dapps and enterprise engineering. Working to solve some of the most challenging problems in the blockchain space, we frequently collaborate with renowned companies, such as Ethereum Foundation, Starknet Foundation, Gnosis Chain, Flashbots, Forta Protocol, Lido, EigenLayer, Open Zeppelin, RISCZero, Aleph Zero, and many more. Today, we are a 350+ strong team working remotely across 66+ countries. About Starknet is the fastest-growing network in terms of new developers joining th

What are we all about?

We are a team of builders and researchers on a mission to empower enterprises and developers worldwide to access and build on decentralized systems.

Our expertise covers several domains: Ethereum and Starknet protocol engineering, layer-2, AI, cryptography research, protocol research, decentralized finance (DeFi), security auditing, formal verification, real-time monitoring, smart contract development, and dapps and enterprise engineering.

Working to solve some of the most challenging problems in the blockchain space, we frequently collaborate with renowned companies, such as Ethereum Foundation, Starknet Foundation, Gnosis Chain, Flashbots, Forta Protocol, Lido, EigenLayer, Open Zeppelin, RISCZero, Aleph Zero, and many more.

Today, we are a 350+ strong team working remotely across 66+ countries.

About

Starknet is the fastest-growing network in terms of new developers joining the network. Nethermind builds many developer-facing tools that need to work seamlessly in this fast-paced blockchain. This ecosystem needs contributors with a quality mindset, capable of applying their craftsmanship and systematic creativity to improve its components. Your software engineering experience and ability to rally developers around you could mean the difference between a flawless network upgrade and a community forking event. Do you have what it takes?

As a Blockchain Data Engineer, you will be responsible for extracting on-chain data from various PoS networks. You will be the reference within the company to provide reliable data necessary to perform multiple analyzes and to produce reporting and invoicing.

Responsibilities:

  • Run a scalable, efficient blockchain indexed data platform
  • Extract, Transform and Load data from blockchain RPCs
  • Assist with data analysis queries
  • Design database schema that is performant, scalable, and maintainable
  • Interact with the product teams to provide data and build the applications they are requesting
  • Interact with field experts and answer internal/external questions related to data extraction
  • Build cloud infrastructure to support data engineering efforts.

You Have:

  • Experience/strong interest in blockchain
  • Proficient with Python and at least one of the followingJavaScript/TypeScriptGolang, or Rust.
  • Strong understanding of distributed systems, Restful APIs and hands-on experience with JSON-RPC endpoints
  • Experience with writing infrastructure as code for cloud deployments and microservices for task automation.
  • Proven success in communicating with users, other technical teams, and senior management to collect requirements, and describe data modeling decisions and data engineering strategies
  • Comfort with writing & optimizing SQL queries

Nice to have:

  • Experience working with data-pipeline engines (Airflow, Dagster)
  • Experience working with big data query engines (Apache Spark, Trino, Presto)
  • Experience building reliable infrastructure on the Cloud (AWS, preferred, GCP, Azure) or willing to do so.
  • Experience in fault-tolerant infrastructure & real-time system monitoring
  • A genuine interest in the functioning of the networks you are working with
  • General knowledge of how PoS consensus mechanisms work
  • Experience with Terraform or infrastructure as a code

Perks and benefits:

  • Fully remote
  • Flexible working hours
  • Plus equity

Keep up to date on what we are working on by following us on our social channels:

Permalink

Alchemy Remote
🗓  Sat, Jan 25 A16z AI Apache Spark Blockchain Computer Science Crypto Data science Fintech Infrastructure Snowflake Terraform Version Control 401k Dental insurance Health/medical insurance Vision insurance
Our mission is to bring web3 to a billion people, by providing builders with the tools they need to build exceptional onchain products. Alchemy is the only complete developer platform that offers the powerful APIs, SDKs, and tools necessary to build and scale onchain apps and rollups. Our infrastructure powers 70% of the top web3 teams, 90%+ of web2 companies building in web3 and 100+ million end users. Our customers include top web3 brands like Polymarket, OpenSea, Circle, WorldCoin, as well as major global brands like Shopify and Adobe. The Alchemy team draws from decades of deep expertise in massively scalable infrastructure, AI, and blockchain from leadership roles at leading companies and universities like Google, Microsoft, Facebook, Stanford, and MIT. We're backed by the world's leading VCs and institutions, including: Lightspeed, Silver Lake, a16z, Coatue, Pantera, Addition, Stanford University, Coinbase, and Charles Schwab, among others. The Role Data Infrastruct

Our mission is to bring web3 to a billion people, by providing builders with the tools they need to build exceptional onchain products. Alchemy is the only complete developer platform that offers the powerful APIs, SDKs, and tools necessary to build and scale onchain apps and rollups. Our infrastructure powers 70% of the top web3 teams, 90%+ of web2 companies building in web3 and 100+ million end users. Our customers include top web3 brands like Polymarket, OpenSea, Circle, WorldCoin, as well as major global brands like Shopify and Adobe. The Alchemy team draws from decades of deep expertise in massively scalable infrastructure, AI, and blockchain from leadership roles at leading companies and universities like Google, Microsoft, Facebook, Stanford, and MIT. We're backed by the world's leading VCs and institutions, including: Lightspeed, Silver Lake, a16z, Coatue, Pantera, Addition, Stanford University, Coinbase, and Charles Schwab, among others. The Role Data Infrastructure at Alchemy is foundation on which all of our products are built on. As one of our early Data Engineers in the Internal Productivity team, you'll be working with one of the most sophisticated and high-throughput distributed systems in the blockchain industry. You'll focus on architecting and building new systems as well as improving existing ones for a platform that supports millions of users globally. What You'll Do:

Design and Implementation: Architect and develop data infrastructure solutions leveraging Snowflake’s capabilities to meet business needs. Data Integration: Manage and optimize data pipelines, ensuring seamless integration from diverse data sources. Performance Tuning:

Conduct performance optimization for Snowflake environments, including storage, compute, and query tuning.

Security and Compliance:

Implement best practices for data security, privacy, and governance in alignment with organizational policies and industry standards. Implement best practices to meet SLA requirements of Business Continuity and Disaster Recovery

Collaboration:

Partner with data analysts, scientists, and business stakeholders to understand requirements and deliver solutions and data insights that drive impact. Build production DAG workflows for batch data processing and storage

Monitoring and Maintenance:

Establish monitoring systems for reliability and proactively address issues to ensure system uptime and data in; Set up frameworks and tools to help team members create and debug pipelines by themselves

What We're Looking For:

BS degree in Computer Science or similar technical discipline, MS/PhD a plus. 6+ years experience in a software engineering discipline, with at least 4+ years experience in data engineering or data infrastructure Experience with Airflow, Temporal, or other workflow orchestration tools Experience in streaming data architectures using Kafka and Flink is a plus Experience with Snowflake / Spark / Trino or other query engines Experience with data modeling frameworks such as DBT and SQLMesh Experience working with Apache Iceberg or other data lake formats. Familiar with datalake ingestion patterns Prior experience with data streaming / CDC a plus. Experience with infrastructure as code (Terraform / Pulumi) a plus Self-starter attitude and the ability to execute new ideas with autonomy Know how to find the right balance between perfection and shipping quickly Passion for blockchain technologies a plus  

More on the TeamInternal Productivity is an engineering team whose main purpose is to build tools and use cutting edge technology to improve the productivity and efficiency of internal stakeholders, specifically servicing finance, sales, and data science.  Alchemy is committed to offering competitive compensation, including base salary as well as equity. Additionally, Alchemy offers comprehensive medical, dental, and vision coverage, as well as other benefits such as 401k and unlimited flexible time off. The base salary range for this position is estimated to be between $135,000 - $350,000 annually. Please note this range reflects base salary only, and does not include bonus, equity, or benefits. Your salary will be determined by various factors, including relevant experience, skill set, qualifications, and other business needs.  

Apply Now:

Permalink

IO Global Remote
Who are we? IOHK, is a technology company focused on Blockchain research and development. We are renowned for our scientific approach to blockchain development, emphasizing peer-reviewed research and formal methods to ensure security, scalability, and sustainability. Our projects include decentralized finance (DeFi), governance, and identity management, aiming to advance the capabilities and adoption of blockchain technology globally. We invest in the unknown, applying our curiosity and desire for positive change to everything we do. By fueling creativity, innovation, and progress within our teams, our products and services are designed for people to be fearless, to be changemakers. What the role involves: The primary purpose of this role is to develop high-quality software solutions that meet customer needs. You will be responsible for writing high-quality code for our products. You will work with cutt

Who are we?

IOHK, is a technology company focused on Blockchain research and development. We are renowned for our scientific approach to blockchain development, emphasizing peer-reviewed research and formal methods to ensure security, scalability, and sustainability. Our projects include decentralized finance (DeFi), governance, and identity management, aiming to advance the capabilities and adoption of blockchain technology globally.

We invest in the unknown, applying our curiosity and desire for positive change to everything we do. By fueling creativity, innovation, and progress within our teams, our products and services are designed for people to be fearless, to be changemakers.

What the role involves:

The primary purpose of this role is to develop high-quality software solutions that meet customer needs. You will be responsible for writing high-quality code for our products. You will work with cutting-edge research and technology. To support you on this challenge, our products have software architects, product managers, project managers, formal methods specialists and QA test engineers, with whom you must communicate professionally, effectively and efficiently.

The Plutus Core team is building the core of Cardano’s smart contract functionality on the bedrock of functional programming languages. This interdisciplinary team carries out original R&D and turns the results into production systems. This team has designed and implemented four languages for Cardano smart contracts (Plinth, Plutus IR, Typed Plutus Core, and Untyped Plutus Core) and improved the compiler and runtime with more built-in functions and optimizations, expanding the expressiveness, capability and security of smart contracts on Cardano. The team has formalized the semantics of Typed and Untyped Plutus Core using Agda, developed novel compilation techniques for data types, and Implemented a compiler for compiling Plinth into Untyped Plutus Core, which uses Plutus IR and Typed Plutus Core as intermediate representations. They also implemented evaluators for Typed and Untyped Plutus Core, in Haskell and Agda. They also contributed to Cardano ledger updates for smart contracts, and published peer-reviewed research. .

Coding and Development:

  • Write and maintain code in Haskell.
  • Use Git for version control, committing often, and submitting small pull requests.
  • Write clean, efficient code that meets acceptance criteria and specifications.

Testing and Debugging:

  • Write and execute unit, property-based, and integration tests to ensure code quality.
  • Identify and fix bugs, including emergency fixes for severity 1 issues.
  • Troubleshoot, debug, and upgrade existing software.

Code Reviews and CI/CD:

  • Conduct and participate in code reviews to maintain code quality.
  • Implement and manage CI pipelines using GitHub Actions, troubleshooting and improving as needed, optionally using Nix.

Software Architecture and Security:

  • Design and architect software components.
  • Design secure software and perform security analysis.
  • Review specifications from architects and formal methods specialists.
  • Contribute to algorithm design.

Documentation and Research:

  • Write clear software documentation and technical user manuals
  • Simplify complex blockchain concepts.
  • Read and comprehend research papers on cryptography and blockchain.

Release Management and Agile Practices:

  • Follow release processes, manage cabal project SRPs, and use GitHub Actions.
  • Split work into tickets with acceptance criteria and maintain ticket status using Jira.
  • Adhere to agile software development practices.

Blockchain and Distributed Systems Knowledge:

  • Understand Cardano, Blockchain, and Distributed systems.
  • Be knowledgeable in distributed and concurrent computation.

Collaboration and Independence:

  • Work independently on software tasks, being proactive and requiring minimal supervision.
  • Collaborate with teams across multiple time zones.
  • Integrate software components and third-party libraries.
  • Verify and deploy programs and systems.

Plutus Core

  • Enhance Plutus Core tooling to create a world-class product that meets diverse user needs within technical constraints of the system.
  • Collaborate with engineers and researchers to design and implement essential features for Cardano smart contract languages, compilers, and runtime systems, along with comprehensive user documentation.
  • Engage in technical discussions with peers and stakeholders to drive informed decision-making.
  • Conduct thorough code and design reviews to ensure high-quality deliverables.
  • Provide expert Plutus guidance to partner teams, ensuring alignment and knowledge sharing across projects.

Who you are:

  • Bachelor’s degree in Computer Science, or equivalent practical experience.
  • 1 year of experience with software development, data structures and algorithms.
  • Experience in programming in Haskell or another functional language
  • Experience in designing and implementing programming languages, compilers and runtime systems
  • Exposure to blockchain and UTXO-based ledgers would be a bonus
  • Strong English communication skills, in both speaking and writing
  • Carrying out software development tasks independently
  • Leading by example to build a culture of craftsmanship and innovation
  • Writing documentation for code and technical user manuals

Are you an IOGer?

Do you find yourself questioning the status quo? Do you tinker with ideas and long to turn those ideas into solutions? Are you able to spark thoughtful debates, bringing out the inquisitiveness in others? Does the promise of continuously growing excite you? Then get ready to reimagine everything you thought wasn’t possible because that’s what it means to be an IOGer - we don’t set limits, we break them.

  • Remote work
  • Laptop reimbursement
  • New starter package to buy hardware essentials (headphones, monitor, etc)
  • Learning & Development opportunities
  • Competitive PTO

At IOG, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Apply Now:

Permalink