Caperio AI Performance Platform
  • U.S.A. : 1 (470) 655-6318
    • Brasil : (+55) 11-97506-0418
  • Our Purpose
  • Platform
  • Customer Success
  • Partners
  • Pricing
  • Learn
  • About
CONTACT US
  • Artificial Intelligence
  • Feb 05

Google Brain Introduces Symbolic Programming + PyGlove Library to Reformulate AutoML

Google Brain Introduces Symbolic Programming + PyGlove Library to Reformulate AutoML

A recent study by the Google Brain Team proposes a new way of programming automated machine learning (AutoML) based on symbolic programming.

Original article available here.

A recent study by the Google Brain Team proposes a new way of programming automated machine learning (AutoML) based on symbolic programming. The researchers have also introduced PyGlove, a Python library that demonstrates the new paradigm’s promising results.

Neural network architectures are becoming increasingly complex, and finding the right one for a task is time and resource consuming. Since Google coined the term AutoML for its neural architecture search (NAS) solution in May 2017, the approach has gained traction in the ML research community for automating network hyperparameter and architecture choices.

Current software limitations have however hindered AutoML advancement. Popular NAS algorithms, for example, require implementation for coupling the AutoML search space and search algorithm, and implementing complex search flows to handle the dynamic interactions between such AutoML components remains difficult.

In the paper PyGlove: Symbolic Programming for Automated Machine Learning, researchers identify a potential solution — reformulate the program logic for AutoML as an automated process for manipulating ML programs symbolically.

Another important AutoML component is the child program, which refers to a performant program that could be a neural network architecture or a data augmentation policy. AutoML works to identify performant child programs out of a large set of possibilities defined by the search space. The search algorithm needs to iteratively sample multiple child programs to select and evaluate the most promising ones. A numeric measure of quality and reward is then fed back to the search algorithm to improve future child program sampling.

The researchers’ symbolic programming approach for AutoML enables the manipulation of a symbolic tree-based representation that encodes a machine learning program’s critical elements. As a result, the ML programs became mutable objects and can be cloned and modified after their creation. In this way, modifying an ML program no longer requires ML practitioners to repeatedly create objects from scratch — they can instead clone existing objects and modify them into new programs. With symbolic programming, the interactions between the child program, search space and search algorithms are no longer fixed, making AutoML programming more flexible.

To test the potential of their novel reformulation, the researchers introduced a general symbolic programming library for Python dubbed PyGlove, which enables AutoML techniques to be easily dropped into preexisting ML pipelines. The modification of search spaces, search algorithms and search flows can then be performed with only a few lines of code.

The proposed approach promises to simplify the development of search-based programs, which the researchers suggest could benefit research areas such as medicine design and video surveillance. Google’s AutoML has already helped developers design efficient new neural networks for practical use, and the Google Brain researchers believe their proposed symbolic programming combined with PyGlove will make AutoML even more productive and accessible to ML practitioners.

The paper PyGlove: Symbolic Programming for Automated Machine Learning was accepted at NeurIPS 2020 and is available on arXiv.

Related Posts

How AI Can Transform Contact Centers’ Unstructured Content
Artificial Intelligence Contact Centers

How AI Can Transform Contact Centers’ Unstructured Content

Original article available here. How AI Can Transform Contact Centers’ Unstructured Content If your organization is drowning in unstructured content, it’s not alone. IDC predicts 80% or more of global content and data will be unstructured by…

Roy
  • Mar 18
How Call Centers Can Thrive by Successfully Managing the Unexpected with AI
Artificial Intelligence Contact Centers

How Call Centers Can Thrive by Successfully Managing the Unexpected with AI

Original article available here. With call center conditions constantly changing, companies must turn to artificial intelligence technology in order to optimize their operations. Call Centers are constantly dealing with unexpected scenarios, but 2020 has taken…

Roy
  • Jan 08

Search

Recent Posts

  • How AI Can Transform Contact Centers’ Unstructured Content
  • Google Brain Introduces Symbolic Programming + PyGlove Library to Reformulate AutoML
  • How Call Centers Can Thrive by Successfully Managing the Unexpected with AI
  • 10 Unique Use Cases for Speech Analytics
  • How AWS is staking its claim on tomorrow’s contact centers

Recent Comments

  • Roy on The Amazing Ways Duolingo Is Using Artificial Intelligence To Deliver Free Language Learning

Archives

  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020

Categories

  • Analytics
  • Artificial Intelligence
  • Contact Centers
  • Remote Agents
  • Speech Analytics
  • Technology
  • Uncategorized

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Subscribe to Our Blog

I want the latest update in...

    Latest Post

    How AI Can Transform Contact Centers’ Unstructured Content

    How AI Can Transform Contact Centers’ Unstructured Content

    • March 18, 2021
    • [rt_reading_time postfix="mins read" postfix_singular="min read"]
    Google Brain Introduces Symbolic Programming + PyGlove Library to Reformulate AutoML

    Google Brain Introduces Symbolic Programming + PyGlove Library to Reformulate AutoML

    • February 5, 2021
    • [rt_reading_time postfix="mins read" postfix_singular="min read"]
    How Call Centers Can Thrive by Successfully Managing the Unexpected with AI

    How Call Centers Can Thrive by Successfully Managing the Unexpected with AI

    • January 8, 2021
    • [rt_reading_time postfix="mins read" postfix_singular="min read"]
    10 Unique Use Cases for Speech Analytics

    10 Unique Use Cases for Speech Analytics

    • December 14, 2020
    • [rt_reading_time postfix="mins read" postfix_singular="min read"]

    Follows Us

    Company

    • About us
    • Careers
    • Learn
    • Blog
    • Contact us
    • Privacy Policy

    Platforms

    • Caperio AI Engine
    • Business Scenario Libraries
    • Caperio Workbench
    • Integrations

    Support

    • Help Desk
    • Knowledge Base

    Community

    • Webinars
    • Faq’s

    Contact

    • support@bossanovadata.com

    © 2023. Copyright BossaNova