WebML WG Hybrid Meeting at TPAC 2022

🛑 The Web Machine Learning Working Group's hybrid TPAC meeting scheduled 13 September 2022, 15:00 - 18:00 America/Vancouver is canceled due to key participants' inability to attend the in-person meeting. The W3C & Ethics workshop at TPAC will be organized and is expected to discuss ML topics and welcomes contributions.

The Working Group's teleconferences continue as usual and will not overlap with the TPAC meetings week.

We'll discuss open issues and review PRs based on your feedback:

• ⨀ All open issues
• ⛙ All open pull requests

Please suggest issue(s) and PR(s) you'd like to see discussed on this teleconference in this issue.

We'll discuss open issues and review PRs based on your feedback:

• ⨀ All open issues
• ⛙ All open pull requests

Please suggest issue(s) and PR(s) you'd like to see discussed on this teleconference in this issue.

Let's use this meta issue to capture preference for teleconferences.

If you'd be interested in a monthly call (30 minutes), please add your current UTC timezone offset to this issue to help meeting scheduling.

I'll start with mine, UTC +2.

This issue is to collect low- and high-level use cases of WebML API to input to the F2F meeting at TPAC 2018.
https://github.com/webmachinelearning/meetings/blob/master/2018-10-26-lyon/README.md#1600-target-demographic-use-cases-and-requirements-all

WebML WG Virtual Meeting at TPAC 2021

📢 This issue is to collaboratively work out an agenda for the Web Machine Learning WG Virtual Meeting at TPAC 2021 event. Your suggestions for agenda topics are welcome via comments. 👇

Registration

TPAC registration will open on 20 September 2021, register via https://www.w3.org/2021/10/TPAC/

Logistics

CONFIRMED dates and times, 1 hour a day, subject to the agenda:

– ⏰ 26 October 2021 14:00-15:00 UTC+0 (see your local time) - 🗓️ Calendar
– ⏰ 27 October 2021 14:00-15:00 UTC+0 (see your local time) - 🗓️ Calendar
– ⏰ 28 October 2021 14:00-15:00 UTC+0 (see your local time) - 🗓️ Calendar

• Chair: Anssi
• Scribe: ?
• IRC: irc://irc.w3.org:6667/#webmachinelearning
• IRC web client: https://irc.w3.org/?channels=#webmachinelearning
• Call-in details: https://lists.w3.org/Archives/Member/internal-webmachinelearning/2020Apr/0000.html
• Minutes:
  • https://www.w3.org/2021/10/26-webmachinelearning-minutes.html
  • https://www.w3.org/2021/10/27-webmachinelearning-minutes.html
  • https://www.w3.org/2021/10/28-webmachinelearning-minutes.html

✋ Setting the context

TPAC meeting is an opportunity for a Working or Interest Group:

• look on the progress and goals of the Group as well as the deliverables;
• look at related work (e.g in Community Groups) and what's new out there within the scope or related to the Group's mission;
• welcome new participants, understand their interests, get their questions/feedback on the Group, and potentially mentor them on how to contribute;
• welcome observers, understand their interests in the Group, and get them interested in joining the Group and helping;

Agenda

⏰ 26 October 2021 14:00-15:00 UTC+0 - 🗓️ Calendar - 📝 Minutes

ℹ️ Rationale/criteria for adding new ops to the WebNN API

Contributors: @wchao1115, @jbingham & @pyu10055, Michał Karzyński @postrational

Discuss what makes for a good criteria to ensure the WebNN API evolves and its scope is driven by right priorities, identify and distill key learnings from related work.

References:

• WebNN use cases and first-wave models
• WebNN samples
• Proposing a new op to ONNX
• Create an op in TF
• Writing custom ops in TF.js
• Adding new operators, view from ONNX by Michal Karzynski

ℹ️ Versioning and web compatibility

Contributors: @cynthia @torgo / @w3ctag

Discuss how versioning fits into the web platform, techniques that enable conditionally running code, best practices, common pitfalls.

References:

• ONNX versioning
• Feature detection and Undetectables
• Graceful degradation versus progressive enhancement
  
• New features should be detectable

ℹ️ Privacy and security discussion

Contributors: Christine Runnegar @w3cping, Dzmitry Malyshau @kvark Kai Ninomiya @kainino0x Corentin Wallez @Kangz / WebGPU, @jbingham / Model Loader

Revisit privacy discussion and related work happening in the WebGPU WG, discuss fingerprinting guidance from PING and evaluate its mitigations.

References:

• Fingerprinting Guidance and mitigations
• WebGPU Security and Privacy Considerations
• WebNN Security and Privacy Considerations
• WebNN open privacy issues

⏰ 27 October 2021 14:00-15:00 UTC+0 - 🗓️ Calendar - 📝 Minutes

ℹ️ ML JS framework performance, focus areas for WebNN

Contributors: @huningxin, @wchao1115, @pyu10055 / TF.js, @EmmaNingMS & co / ONNX Runtime Web, @dtig @penzn / Wasm SIMD, @mingqiusun / WASI

Review ML JS framework performance data across backends, discuss learnings from backend implementation efforts.

References:

• WebNN ML JS Frameworks Performance, presentation slides
• ONNX Runtime Web
• XNNPACK backend for TensorFlow Lite

ℹ️ Integrating an open-source cross-platform implementation of the Web Neural Network API into a web engine

Contributors: @huningxin, @fujunwei, Corentin Wallez @Kangz & co / WebGPU & Dawn

WebNN-Native is a software project that implements the WebNN API specification on top of DirectML, OpenVINO, oneDNN and XNNPACK backends across Windows 10 and Linux. In this session we will introduce the project and discuss web engine integration plans. The goal of the session is to encourage new contributors to the WebNN-Native project and identify new stakeholders interested in web engine integration.

References:

• WebNN-native
• WebNN-native performance comparison
• WebNN implementation in Chromium Design Doc

ℹ️ Privacy and security discussion continued

Continue from where we left on Day 1. Discuss Model Loader API security.

⏰ 28 October 2021 14:00-15:00 UTC+0 - 🗓️ Calendar - 📝 Minutes

ℹ️ Conformance testing of WebNN API

Contributors: @wchao1115, @dontcallmedom, Feng Dai @BruceDai

Discuss the progress in conformance testing of the WebNN API, web-platform-tests migration.

References:

• WebNN web-platform-tests WIP (tracking issue)
• Conformance testing of ML APIs for the Web

ℹ️ Ethical issues in using Machine Learning on the Web

Contributors: @anssiko, @dontcallmedom

The Working Group is committed to develop a Working Group Note documenting ethical issues associated with using Machine Learning on the Web. Review the early document stub and have a discussion on a subset of ethical issues to focus on at the intersection of ML and the web platform.

References:

• Ethical Web Machine Learning

⏰ Not yet scheduled

ℹ️ WebNN API spec technical discussion

The familiar GH issue and PR-driven discussion/triage/new feature proposal review. Details to be confirmed closer to the meeting.

ℹ️ Technical demos

WebNN technical demos to be shared with the broader W3C community at TPAC.

As in previous years, as part of TPAC, W3C groups have an opportunity to produce short videos to share updates from the group's work and/or technical demos illustrating the latest developments.

Interested in sharing a demo? See best practices and get in touch with @dontcallmedom (dom at w3.org).

Registration

• Registration is now open until 13 September 2024: https://www.w3.org/register/tpac2024
• All registered WebML WG/CG participants and invited guests welcome.

Logistics

• 🏨 Venue: Hilton Anaheim in-person & remote
• 🗓️ Meeting invite: 23 September 2024, 09:00–18:00 Pacific Daylight Time
• ⏰ Schedule: 23 September 2024, 09:00–18:00 PDT local time (see your local time)
  • ⏰ Start: 9:00 local / 16:00 UTC
  • ⏰ Morning break: 10:30 - 11:00 local / 17:30 - 18:00 UTC
  • ⏰ Lunch: 12:30 - 13:30 local / 19:30 - 20:30 UTC
  • ⏰ Afternoon break: 14:30 - 15:00 local / 21:30 - 22:00 UTC
  • ⏰ End: 18:00 local / 00:00 UTC
• 📞 Zoom details: see 🗓️ Meeting invites that are updated with the Zoom URLs closed to the meeting
• ✍️ IRC: IRC web client or irc://irc.w3.org:6667/#webmachinelearning
• ✍️ Minutes: https://www.w3.org/2024/09/23-webmachinelearning-minutes.html

Related meetings

• Check out the breakout schedule for 1-hour sessions on new or existing topics

Agenda

⏰ Start meeting 9:00 local / 16:00 UTC

👋 Welcome

• Intros
• Agenda bashing

📘 Charter orientation

• WG and CG interplay
• Current scopes, future aspirations
• Deliverables: WebNN, Ethical Principles, tentative Model Loader
• Coordination with other groups

😇 Ethics

• 📍9:30-10:00 In-browser explainability libraries and viz tools (@xiaohk, OpenAI / Georgia Tech)

⏳ Spec orientation

• Triage pass through open issues: breaking changes, priorities, next steps for the issue (All)

⌛ Break 10:30 local / 17:30 UTC

⏰ Resume meeting 11:00 local / 18:00 UTC

✨ New features

• A refreshed analysis of popular models, operator & data type gaps (@fdwr)
• Quantization and dequantization (QDQ), a bag of multiple issues (@inexorabletash)
• Platform capability detection (@philloooo)
• Future-proof device selection abstractions (@mwyrzykowski)

🍴 Lunch 12:30 local / 19:30 UTC

⏰ Resume meeting 13:30 local / 20:30 UTC

📢 Customer feedback & collaborations

• 📍13:30-14:00 WebLLM + MLC (@tqchen)
• Transformers.js WebNN backend (@xenova) xenova/transformers.js#890
• ONNX Runtime Web & WebNN EP
• Google Chrome Feedback revisited #453

☕ Afternoon break 14:30 - 15:00 local / 21:30 - 22:00 UTC

⏰ Resume WG meeting 15:00 local / 22:00 UTC

🤝 Interop and cross-group coordination

• Interop issues across different backends (@huningxin)
• Core operator set #573
• MLTensor (was MLBuffer) #754 (@a-sully)
• MLConstantOperand #668 (@reillyeon)

🔮 Implementation plans and trials

• Next step for implementations, Origin Trial or equivalent and align with framework developer feedback

🛤️ Advancement on the W3C Rec Track

• Wide review status, close on TAG review feedback
• W3C “living standards” expectations (@dontcallmedom)

🌱 Incubations

• Custom ops (@huningxin)
• Built-in APIs for translation and prompting (@domenic)
• Model management (@mmccool)

🫶 Wrap up

• Synthesis of key outcomes, next steps

⏰ End meeting 18:00 local / 00:00 UTC

• 🍴 Group dinner

We'll discuss open issues and review PRs based on your feedback:

• ⨀ All open issues
• ⛙ All open pull requests

Please suggest issue(s) and PR(s) you'd like to see discussed on this teleconference in this issue.

We'll discuss open issues and review PRs based on your feedback:

• ⨀ All open issues
• ⛙ All open pull requests

Please suggest issue(s) and PR(s) you'd like to see discussed on this teleconference in this issue.

Given the increased participation in the group I think it would be appropriate to hold a hybrid meeting at TPAC 2024 in Anaheim, CA.