Are you a seasoned Data Operations Engineer looking for a challenging role that will push you to utilize your broad and deep data skillset? If so, we want you to join our team at AdScribe, a subsidiary of 605!
As a Data Operations Engineer at AdScribe, you will have the opportunity to design and build modern analytics environments that comprise raw data stores and cleansed data repositories using batch or streaming data pipelines. You will be responsible for building, supporting, and monitoring data pipelines and applications while ensuring the highest levels of performance, availability, security, and compliance of data.
Responsibilities:
- Manage and support the daily operation of data ETL pipelines in the Data Operations space.
- Build data flows for acquisition, modeling, and aggregation using batch and streaming paradigms.
- Consolidate/join datasets to create easily consumable, consistent, holistic information.
- Ensure Data Pipelines meet their SLAs and adopt key practices, including incident and problem ownership, system reporting, monitoring, and escalation.
- Work on unique and interesting data challenges around architecting, building, and managing pipelines that securely process hundreds of terabytes of data.
- Work closely with analysts and statisticians to ensure the validity of our processes.
Requirements
Requirements:
- Extensive experience designing and implementing ETL pipelines.
- Experience with ETL job automation through Airflow pipelines.
- Experience building and operationalizing large-scale enterprise data solutions, Data Lakes, and applications using one or more of AWS data and analytics services.
- Experience with AWS products (Redshift, EC2, EMR, S3, IAM, RDS, AWS Glue, CloudWatch, etc.) and Databricks.
- A strong understanding of data structures, algorithms, and effective software design.
- Significant development experience with a major modern language (e.g., Java, Scala, Python, Spark, etc.).
- Significant experience working with structured and unstructured data at scale and comfort with a variety of different stores (key-value, document, columnar, etc.) as well as traditional RDBMS and Data Warehouse.
- Exposure to visualization tools such as Tableau, Google Analytics, JIRA, and MS Project.
- Ability to multi-task and manage multiple environments.
- Provide on-call support and remote troubleshooting.
- Must work well in an agile, collaborative team environment.
Benefits
- Competitive salary and benefits package.
- Opportunities for professional development and advancement.
- Collaborative and supportive work environment.
- The chance to work on unique and interesting data challenges.
- Opportunity to work with the latest AWS products and technologies.
Join our team at AdScribe, and be part of a dynamic and innovative team working on exciting data projects that make a real difference!