Lead Data EngineerExpired
We are the catalysts enabling crypto companies — trailblazers and disruptors which are pushing the boundaries of innovation — to scale and mature so that a full range of individuals, entities, and services may transact with crypto safely.
We are looking for a savvy Data Engineer to build our data infrastructure. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. Startup experience or interest in blockchains would be a plus for the role.
What does the Product do?
We are known industry-wide for our predictive crypto risk & intelligence platform’s best-in-class user experience and unmatched customizability. Our solutions provide next generation crypto threat detection, risk management and compliance for businesses, banks and government agencies.
Our growing solution suite includes transaction screening and wallet monitoring, crypto crime investigation tools, enhanced due diligence and entity reporting, and crypto compliance and investigation training.
Our global and collaborative team is building the technology that will set the standard for the next generation of financial safeguards and criminal detection. Our product roadmap will enable our clients to grow and thrive in this flourishing industry.
Web-application is completely written on Python, Vue.js and React.js
Infrastructure is deployed through Google Cloud and Amazon Web Services using Docker, Kubernetes and Terraform
We use Apache Beam, Apache Airflow and AWS Sagemaker to manage our Big data and AI workflows
Clickhouse and TigerGraph are the analytical data-warehouses
What will you do?
Create and maintain optimal data pipeline architecture for our workloads. This includes building highly resilient architecture for both streaming and batch ETL processes.
Have a good understanding of data structures used by public blockchains to store data. A significant portion of our data pipelines parse blockchain data and store them in our data warehouses
Assemble large, complex data sets that meet functional / non-functional business requirements. This includes expanding the scope of our data-mining efforts by building data pipelines to crawl data from the darkweb, openweb, third party data sources.
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
Works closely with a team of frontend and backend engineers, product managers, and analysts to render data on to our products.
Implement algorithms to transform raw data into useful information
Build, Manage and Deploy AI / ML workflows
What makes you a great addition to the team?
5+ years of relevant experience as Big Data Engineer
Experience in building data pipelines using open-source tools such as Apache Airflow, Apache Beam or Spark
Good understanding of python, bash scripting and basic cloud platform skills (on GCP or AWS)
A working knowledge of Docker is a plus. An understanding of Kubernetes or Terraform is a plus plus.
Analytical mind with a business acumen
Excellent communication skills
Other information you may want to consider
We will be flexible for the rest of the pandemic and work remotely; however, we are not a remote-first company, and the work location would be Bangalore when things settle. The team at Merkle is heavily driven by growth, and if you would like to, there will be numerous opportunities to experiment.
Well Being, Compensation and Benefits
We care about your well-being. Along with excellent health insurance, we offer flexible time off, numerous Learning & development initiatives where Merkle Science invests in employee development, and working hours that we have not heard a single complaint against. We respect your weekends too. We regularly host team-building sessions and encourage discussions around mental well-being as well.
On the compensation front, We admire the talent and believe in rewarding people for their inputs. Compensation is best in class, and the whole process will be transparent from the very minute we speak to you.
This job post is no longer available. Click the button below to view available jobs.Back to job board