Onebridge is seeking a full-time Big Data Engineerto join our growing Data Analytics Practice on-site in Indianapolis supporting a range of leading clients and industry verticals. We have a high preference for local candidates who can work on our W2 without sponsorship.
The Big Data Engineer will serve in a key role within our Data Practice, working alongside Machine Learning Engineers and Data Scientists to build a platform that will inform detection of business critical systems. Must be highly analytical and have the proven ability to develop and reverse engineer complex solutions. The Big Data Engineer must be experienced in SQL, Python, Kafka for data streaming, Plotly for visualization, ETL development and system integration. Critical thinking and advanced problem-solving skills are core behaviors among the team.
Big Data Engineer | Core Duties:
Participates in the workstream planning process including inception, technical design, development, testing, and delivery of end-to-end BI solutions.
Designs, develops and tests databases, data warehouses, data lakes, queries and views, reports, and dashboards.
Performs data conversions, imports, and exports of data within and between internal and external software systems.
Merges BI platforms with enterprise systems and applications.
Documents new and existing models, solutions, and implementations.
Data Engineer | Key Skills:
7+ years' experience with advanced knowledge in Data Engineering/Development
5+ years of ETL experience
5+ years of Python
Expertise with data streaming using Kafka.
Experience using Plotly for visualization Proof-of-Concept
5+ years of proficiency with data integration, data pipelining, database development, data lakes, etc.
Able to quickly visualize data and create dashboards using tools such as PowerBI, Tableau, Qlik, and Alteryx
Possess strong MSBI Stack including SSRS, SSIS, SSAS with advanced T-SQL
Expertise in tabular and multidimensional queries (DAX, MDX)
Solid understanding of ETL strategies and design, (staging environments, data transformation, change data capture, slowly changing dimensions, etc.), with an eye towards delivering functional and useful solutions in a timely manner
Experience creating global BI Solutions and working with Cloud BI tools such as AWS or Azure
Deeply understands bi-directional MDM
Data Engineer | Desired Extras:
Wrangling Data Flows, Azure Data Share, Azure Databricks
PySpark, Spark, Scala, Stream Analytics, HDInsight and Hadoop