Major Features and Improvements

• Released MediaPipe Solutions APIs for Java, Python and Web that offer advanced end-to-end solutions for end-to-end on-device ML.

Bug Fixes and Other Changes

Bazel changes

• Updated bazelrc with required config

Framework and core calculator improvements

• Added Language Detector Python API and fixed a typo in Interactive Segmenter Options' docstring, Update CalculatorOptions to encourage proto3 options
• Updated roi not allowed check in ios vision task runner
• Updated normalized rect calculation for some angles in MPPVisionTaskRunner
• Added shell script for building cocoapods archive
• Added more pose landmarker tests and updated face landmarker tests to cover all the results
• Added Language Detector Python API and fixed a typo in Interactive Segmenter Options' docstring
• Add nullable annotation to AudioDataProducer#setAudioConsumer
• Add a default_applicable_licenses to model_maker/python/vision/core
• Added podspec for CommonObjects and Vision tasks
• Add customizable face stylizer module in MediaPipe model maker
• Add custom metadata for object detection model with out-of-graph nms
• Update MPImage to use containers
• Update the face stylizer config to match the latest encoder and detector config
• Add nose in facemesh drawing
• Added config for fat simulator builds
• Added http_archive to download opencv sources
• Added config settings to select building iOS xcframework from source for certain configs
• Updated BUILD files to use the open sourced Language Detector model
• Add the TFLite conversion API to BlazeFaceStylizer in model maker
• Add the "FACE_ALIGNMENT" output stream to the face stylizer graph
• Add an extra op to rescale face stylizer generation output from [-1, 1] to [0, 1]
• Add TransformerParameters proto
• Updated docuemntation of MPPObjectDetector
• Added hash implementation for iOS normalized keypoint
• Updated wait time for object detector tests
• Updated pixel format types in object detector
• Added flow limiter calculator and conditionally selected xcframework in iOS framework targets
• Added conditional building of opencv xc framework to test targets
• Update CalculatorOptions to encourage proto3 options
• Add support for single-channel images to MPImage

MediaPipe solutions update

Android

• Move Java Connections arrays to Task class

iOS

• Updated roi not allowed check in iOS vision task runner
• Removed roi apis from iOS object detector
• Added iOS Object Detector Objective D tests
• Removed detect in image with region of interest api from iOS Object Detector
• Updated iOS tests to reflect the new orientation calculation
• Updated iOS Image Classifier to reflect new calculation for normalized rect
• Updated build rules for iOS frameworks to duplicate symbols
• Updated iOS cocoapods build script
• Updated iOS framework names
• Added build file for iOS opencv from sources
• Updated iOS object detector to use delegates instead of callbacks for async calls
• Added hash implementation for iOS normalized keypoint
• Added flow limiter calculator and conditionally selected xcframework in iOS framework targets
• Updated deps names in iOS test targets
• Added iOS task text cocoapods podspec
• Added targets for iOS text frameworks
• Added method for creating unique dispatch queue names in MPPVisionTaskRunner

Javascript

• Add scribble support to InteractiveSegmenter Web API
• Update WASM files for Alpha 14
• Add .close() method to ImageSegmenterResult/InteractiveSegmenterResult/PoseLandmarkerResult
• Update FaceStylizer, ImageSegmenter, InteractiveSegmenter, PoseLandmarker to return MPImage

Python

• Added the PoseLandmarker Python API and a simple test
• Populate labels using model metadata for the ImageSegmenter Python API
• Added the Face Aligner Python API
• Expose PoseLandmarker as a public MediaPipe Tasks Python API
• Expose FaceAligner and LanguageDetector to be public MediaPipe Tasks Python API
• Add image_segmenter_metadata_schema and object_detector_metadata_schema python files to the mediapipe python wheels
• Add HAND_CONNECTIONS to HandLandmarker and GestureRecognizer

MediaPipe Dependencies

• Aded version of dependency to podspec template
• Updated common dependencies to link in helpers