The Senior Data Engineer will be responsible for expanding, migrating and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection to meet the needs of users across the organization. This position will also be accountable for making recommendations to strengthen system controls, increasing efficiency using automated processes, and documenting technical requirements and specifications. This role will also be responsible for making system and application recommendations based upon industry best practices, technical viability and operational standards. As a senior member of staff, this individual will be expected to mentor junior staff and provide guidance in solution design.
Academic and Trade Qualifications:
Bachelor's degree in Computer Science, Computer Information Systems, Computer Engineering, Math, or related technical degree from an accredited institution, and/or equivalent experience.
Ten years of demonstrated work experience with a minimum of five years of experience in the area of Data Engineering or Data Warehousing. Five years of experience in a Microsoft environment working with data warehouse technical architectures, ETL/ELT, and reporting/analytic tools. Experience in the public utility industry or energy sector is preferred.
Identify, retrieve, manipulate, relate, and exploit multiple structured data and unstructured data sets from various sources, including building or generating new data sets as appropriate
Develop enterprise level data APIs and data pipelines using object-oriented languages (C#.NET, Java), scripting (Python, PowerShell, etc.), and data formats (XML, JSON)
Work with complex databases, conduct in-depth research to identify data issues, propose solutions to improve data integrity, and perform other database-related analyses and projects as requested
Partner with internal customers, architects, programmers, and other technical partners to gather requirements, understand existing systems, and develop products to maximize secure and compliant application observability
Design and develop ETL code and document implemented ETL designs
Proactively review, streamline and suggest improvements to our current processes and documentation
Define and document standards for transforming data and executing pathways/flows from a variety of complex sources
Take a leading role in defining the processes, standards, and roadmap for data warehousing, analytical reporting, operational reporting, ETL/ELT processes, data governance, and master data management, while mentoring junior staff
8+ years of experience with SQL
5+ years of working with enterprise/solution architecture frameworks, methodologies, templates, and tools
Ability to understand business objectives and develop data solutions to meet those needs
Strong working knowledge of modern programming languages, ETL tools and understanding of cloud concepts
Deep knowledge of data warehouse tools
Understanding of advanced principles and practices of database management systems, standard IT operating procedures and should be able to read, interpret and produce technical documentation.
Abilities and Skills:
Experience leveraging Cloud services for scalable solutions
Experience optimizing data retrieval and converting legacy processes to a modern architecture
Strong analytic skills related to working with structured and unstructured datasets
Experience designing, developing, testing and supporting software in support of data initiatives
Excellent listening, interpersonal, written, and oral communication skills.
Ability to work independently with minimal supervision and excel at meeting deadlines.
Relationships and Contacts:
Reports To: Director, Software Services
Company Profile: NCEMC (http://ncemcs.com/about/ncemc.htm) is one of the largest generation and transmission cooperatives in the nation and is the power supplier for most of the state's member cooperatives. NCEMC acquires the power it sells to its member cooperatives in a number of ways, including asset ownership and Purchased Power Agreements.
North Carolina Electric Membership Corporation provides equal employment opportunities (EEO) to all applicants for employment.