InfoQ Homepage News A Team's Transformation from Software Development to ML: Golestan Radwan at QCon NY

The next QCon is in London, Mar 4 - 6, 2019. Save an extra £75.00 with INFOQ75!

广东今晚36选7开奖结果: A Team's Transformation from Software Development to ML: Golestan Radwan at QCon NY


As companies start to add Big Data and Machine Learning initiatives to their project portfolios, they face several challenges including the teams' transition from software engineering to data engineering and machine learning. Golestan "Sally" Radwan recently spoke at QCon New York 2018 Conference about her experience in leading a traditional software engineering team on a machine learning/AI journey.

Radwan talked about what went well in the transition of a software architect to data architect. Techniques like frequent and visual communication helped them but they had to make some tough technology and people decisions. She discussed three levels of transformation:

  • Individual
  • Team
  • Business

Individual transformation included moving from languages like PHP and Python; changing the technology was not easy. The developers had to get comfortable with handling completely different data structures, formats, and data sources.

They also had to learn to work a lot more closely with DevOps. She advised the developers to learn fast and be ready to make compromises. It's important to lean on your team. Architects should learn about data and machine learning pipelines. Focus on performance of each algorithm and its pros/cons and suitability for different types of data.

Some of the disciplines and resources they relied on for this transformation included the following:

At the team level, they focused on regular knowledge sharing sessions; "lunch and learn" meetings were held every Thursday, in which team members could share what they learned. They also codifed this knowledge and automated associated processes using CircleCI in order to make the most use of Data Scientists valuable time.

Speaking of Data Science discipline, Radwan suggested to look for some development skills (at least to prototype) when hiring data scientists. Probe their real world understanding to learn how much they care about the big picture, company goals, and how they fit in the organization.

And finally at the organization level, if you have a podium, speak up and set expectations to your stakeholders. Educate and collaborate with other teams. It's important to be clear on targets, goals, and requirements. In the machine learning space, your responsiblility includes privacy, provenance, bias, and quality. Take time to understand the context and implications of what you're doing.

Radwan mentioned the presentation on analyzing the bias in machine learning at 2018 Conference by Rachel Thomas. She concluded the discussion by suggesting the teams resist the urge to overcomplicate things so they can be successful in their machine learning initiatives.

Rate this Article


Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p


Is your profile up-to-date? Please take a moment to review and update.

Note: If updating/changing your email, a validation request will be sent

Company name:
Company role:
Company size:
You will be sent an email to validate the new email address. This pop-up will close itself in a few moments.
  • 世界杯专版 竞猜型彩票 赔率是公认的竞猜利器 2019-02-21
  • 反制更快更强更准!中国坚决打赢对美贸易自卫反击战! 2019-02-20
  • 北京国际旅博会开幕 旅游产品直降数千提前带热暑期档--旅游频道 2019-02-19
  • 世界杯倒计时:球迷街头狂欢为自己的国家打Call 2019-02-18
  • 这论坛需要风水们创新、发展,他们也只能靠这个了······ 2019-02-18
  • 雷政富狱中发声:否认漏罪举报 不服原判正申诉 2019-02-17
  • 央行:有效防控互联网金融领域风险 2019-02-16
  • 苏57空中姿态控制能力瞬间救场, F22隐身战机无法超越! 2019-02-15
  • 这泼猴总给人萌萌达的感觉 2019-02-15
  • 十年前人大代表工作二三事 2019-02-14
  • 厦门出现不打烊的便民服务站 2019-02-13
  • 故事新西兰强震致民宅破坏严重 超市遭抢购 2019-02-12
  • 中关村医院为中科院科研人员提供就医绿色通道 2019-02-11
  • 候选企业:内蒙古呼和浩特金谷农商银行 2019-02-11
  • 百姓满意的口碑,就是最高荣誉! 2019-02-10
  • 649| 707| 410| 623| 434| 855| 593| 963| 949| 693|