@dooy
2018-03-03T12:00:44.000000Z
字数 1960
阅读 170
随笔
https://www.linkedin.com/in/zheng-shen-71794580/
The Data Center is designed to handle the challenge of mass data storage and processing on pigai.org (a NLP trained system which can score English essays of Chinese student online automatically and provide detailed feedback within few seconds). Besides high-speed and reliable data ingestion, the data center provides real time or NRT APIs for data aggregation/analysis for BI and other pigai.org applications (e.g. plagiarism checking within over 300 million historical documents in million seconds level)
In 2016, the data center successfully helped pigai.org to improve the user experience significantly in the event of online English Essay Competition 2016. In this event, nearly one million Chinese high school students submitting their essay in english of same title on pigai.org within a small window of time. The score and feedback are provided in real-time matter, and the essay with the highest score wins the competition. The pigai.org encountered zero system jamming/offline issue during the event comparing to multiple times of system offline in year 2015 competition without Data Center support.
Responsibilities;
- As architecture, analyze existing system and design the data center from the scratch, and provide migration path to minimal the impacts to online services.
- As chief software engineer, lead implementation and operations of the project.
- Setup development process and infrastructure, such as CI/CD system based on Jenkins, Docker and Kubernetes.
Technologies:
- Hadoop/HDFS, Zookeeper, HBase, Elasticsearch,
- Java/JAX-RS, Python
- MySQL, MongoDB, Redis,
- RabbitMQ
- Svn, Jenkins, Docker for SCM/CI/CD
=====php后端研发工程师 ====15k~20k======
岗位职责:
-负责教育场景下核心业务系统的设计、开发与维护;
-根据业务变化,不断改善产品的系统架构设计,保证系统的性能、可靠性。
岗位要求:
-熟练掌握LNMP开发,并具备良好的编程风格,能把良好的设计理念,思想落实到项目实践中;
-熟悉PHP实现和工作原理,至少熟悉一个PHP框架;
-熟悉mysql,掌握mysql分表、集群等相关设计方案,具备mysql优化经验;
-熟悉redis、mongodb等常用的nosql解决方案,了解各自的优缺点及使用场景;
-了解web前端技术,具有相关开发经验,了解vue react angular 等mvvm前端框架优先
====web前端研发工程师===15k~20k==
岗位职责:
-负责教育场景下核心业务前端研发;
岗位要求:
-1年以上的前端领域开发经验,有移动端开发经验,
-深入理解W3C标准与ES规范,熟悉Html5&CSS3,对业界最新技术有浓厚的兴趣和自己的见解;
-JS 基础扎实,熟练掌握至少一种常见的前端框架,如:Angular / React / Vue等;
-有DCloud ApiCloud相关开发