รายละเอียดงาน
:
Develop big data solutions for batch processing and near real-time streaming.
Retrieve, prepare, and process a rich data variety of data sources.
Work with business domain experts, data scientists and application developers to identify data that is relevant for analysis.
Keep abreast of new developments in the big data eosystem and learn new technologies.
Triage code problems and data-related issues
คุณสมบัติผู้สมัคร :
3+ years of experience with relational database systems, with expertise in SQL. 3+ years of programming experience in Java, Python, Scala or similar. 3+ years of experience in coding in data management, data warehousing or unstructured data environments. Experience with cloud-based platforms such as AWS, Google Cloud platform or similar. Experience building complex pipelines using automated workflow is a plus, e.g. Luigi, Airflow, Oozie or similar. Experience with parallel data processing is a plus, e.g. MapReduce, Hadoop, Spark or similar. Experience with streaming technologies is a plus, e.g. Kafka, AWS Kinesis or similar. Experience with Business Intelligence tools and platforms is a plus, e.g. Tableau, QlikView, PowerBI, Google Analytics or similar. Experience with Machine Learning is a plus, e.g. TensorFlow, NumPy, Scikit-Learn, Mahout or similar. Good communication in English
