Tuesday, May 7, 2019

Few Google I/O 2019 highlights ... from a dev perspective!


Duplex Web 

 - Allows for booking appointments on website via assistant.

Next Gen Google Assistant

- Quickness - performance enhancement, opens & switches between apps very quickly.
- Enabling support for - 'how to' item sites, smart displays automatically loaded with right visualization
- How to template added to actions console.
- Voice based entry points from assistant into the app - health & fitness, finance, ride-sharing, food ordering.
    --> use your voice to start the run with nike run club  -  simple intent to deep link mapping to app.
    --> interactive canvas - full screen display - using voice, visual & touch - HQ trivia game updated with this experience.

ML enhancements

- ML transported to the site of consumption - handhelds, phones, smart phones - footprint of ML reduced to 0.5 gb via recurrent NN in ML kit.
- Vision -> landmark detection, image labelling, barcode scanning, face detection, Natural language - language detection, smart reply,  Custom - model serving.
- On device translation API for 59 language support.
- Object detection combined with product search API to search retail product effectively.
- AV, VR - apps like IKEA use the above APIs.
- Auto ML - can train accurate models on own data sets, Cloud AutoML tables - ingest & predict ML models.
- Video labelling & video intelligence to search & logically arrange the video content.
- Cloud TPUs reduce speed of training to significantly faster speeds - TPU pods.
- Open source tensor flow - researchers & business 2.0 launched - ML - intuitive models, javascript developers can use node js to deploy models to tensor flow out of the box, tensor flow lite installed - is very fast.
- Federated handoff

Firebase enhancements 

- build your app with fully managed backends, provide monitoring & provide better insights with FB & ML kit - auto vision image edge.
- upload images, click to train model & publish image.
- 1. Auto ML dataset creation, 2. upload of images, 3 train - latency, accuracy - how to train - select training time, once training is finished - evaluation provided with precision percentage & details.
- 4. step - publish the model, 5. push to app, 6. app will dynamically download the model and use it.
- Performance monitoring - startup time, responsiveness - expanded to web - available in beta instantly.

Web platform - Chrome enhancements

 -- reducing startup time - reduced by 50%, v8 - js engine, uses 20% less memory.
 - image lazy loading - add 'loading' attribute to the image - via checking for factors like connection speed, few kilobytes loads an image with a reduced size.
- lighthouse - budget enforced - like 200 kb size, target metrics - page load time - connects with servers to maintain the response within the budget.
- Google duo for web - progressive web app, light and can be used as an immersive experience.
- Google web search uses latest features behind the scenes.
- Web security - all traffic moved to https, private and secure cookies, easy private controls - tracking of sites from across web, anti-fingerprinting .
- web.dev - site created for building, help on web, optimisation on popular platforms like react.

Flutter enhancements

- Technical preview of flutter on the web.
- Write once and use on any device - android, iOS, mac, windows, web.. 
- Flutter sandbox unveils faster processing speeds.

Chromebooks

- Linus for chrome books available for devs - linux ready chrome books launched.

No comments:

Post a Comment