Job Information
Loop Bell Tech Inc. Data Engineer in Novi, Michigan
Create automated data pipelines using workflow orchestration tools. Assemble large data sets that meet functional / non-functional business requirements. Implement error logging mechanisms for identifying the data outliers and failed processes. Interprete problems in existing procedures and framework using data analysis, data mining, optimization tools. Loading of data from a variety of data sources using SQL and AWS 'big data' technologies. Identify and tackle issues concerning data management to improve data quality. Use PySpark, Python, Spark, SQL, Hive, AWS S3, Dynamo DB, Redis Cache, AWS Lambda, Athena, Airflow. Primary worksite is Novi MI, but relocation is possible.