Data Engineer, Web & Social Scraping

Job Overview

JOB DETAILS

REQUIREMENTS

• 3+ years of professional web/software development experience.

• 3+ years experience in Python.

• 2+ years database experience.

• 2+ year Javascript experience.

• 2+ year Selenium experience.

• Knowledge of Browser-Web Server interaction including DNS, HTTP, SSL, GET vs POST.

• ETL, Pentaho experience.

• SQL experience.

• Pandas, scipy, numpy experience.

• Command of software engineering principles, frameworks and technologies.

• Experience prioritizing and performing multiple tasks in time-critical situations.

• Comfort working within a fast-paced, dynamic and distributed environment.

• Attention to detail, strong organizational skills and excellent follow-through.

• Adept problem-solving ability, judgment and resourcefulness.

• Strong written and verbal communication skills.

• Ability to communicate cross-functionally.

• Intellectual curiosity, self-motivation, independent with team building skills

RESPONSIBILITIES

• Connect to public databases to ingest data as well as executing one-off imports of data.

• Create new data ingestion and processing tooling to eliminate manual processes, inefficient or repetitive work, and address quality issues.

• Make thoughtful judgements on data quality to clean data sources for import.

• Use third-party APIs and web scraping tools to source data at scale.

• Work with the team to scale and embed techniques and help with data ingestion projects.

• Demonstrate common sense in applying business logic to ontological/schema decisions.

• Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools

• Develop and implement standards for clean code that maintain modularity, clarity, and portability.

• Actively contribute ideas for product improvements and solutions to technology challenges, including features and performance considerations.

• Contribute to the software release process.

• Demonstrate passion for continued learning by staying abreast of new technology and trends.

Are you interested in this position?

Apply by clicking on the “Apply Now” button below!

#CrossChannelJobs#JobSearch
#CareerOpportunities#HiringNow
#Employment#JobOpenings
#JobSeekers
FacebookLinkedIn