Announcements

• Protobuf News may include additional announcements or pre-announcements for upcoming changes.

Compiler

• Implement proto2/proto3 with editions (https://github.com/protocolbuffers/protobuf/commit/3813b6622f6490b969c16e1b1ba7dcbd8f4e3209)
• Defines Protobuf compiler version strings as macros and separates out suffix string definition. (https://github.com/protocolbuffers/protobuf/commit/3c59585bc116bee70f5f00a10005ea1403aef062)
• Add utf8_validation feature back to the global feature set. (https://github.com/protocolbuffers/protobuf/commit/153028d7f3029e066bb2287012e14417ca83d55c)
• Setting up version updater to prepare for poison pills and embedding version info into C++, Python and Java gencode. (https://github.com/protocolbuffers/protobuf/commit/4322e00e5b4c2f36016f0eee614e0e823a693ed4)
• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)
• Editions: Introduce functionality to protoc for generating edition feature set defaults. (https://github.com/protocolbuffers/protobuf/commit/4019e254322b2312cc7431b45ae71bb8e3dfa035)
• Editions: Migrate edition strings to enum in C++ code. (https://github.com/protocolbuffers/protobuf/commit/f083ebf21f56783fd838c006880f8e16e05d1f1e)
• Create a reflection helper for ExtensionIdentifier. (https://github.com/protocolbuffers/protobuf/commit/4d5ab7324ef4d79eda69c8ed5bcb35f35e6db6f1)
• Editions: Provide an API for C++ generators to specify their features. (https://github.com/protocolbuffers/protobuf/commit/e897bcf3ff8004b7446bbe43a1fc28f9a92a11d4)
• Editions: Refactor feature resolution to use an intermediate message. (https://github.com/protocolbuffers/protobuf/commit/57d8049b01b4bd95a1ca156eb375b523dc7d5d56)
• Publish extension declarations with declaration verifications. (https://github.com/protocolbuffers/protobuf/commit/e72b0e181b236ff23c03a9f9f97f58e6989f25c9)
• Editions: Stop propagating partially resolved feature sets to plugins. (https://github.com/protocolbuffers/protobuf/commit/b66ef4c3f0af899e3736ad016259f9446f0adb14)
• Editions: Migrate string_field_validation to a C++ feature (https://github.com/protocolbuffers/protobuf/commit/1f9583069f0e2b11790ea36cc760ee371106f232)
• Editions: Include defaults for any features in the generated pool. (https://github.com/protocolbuffers/protobuf/commit/15863ffc9aff9d31e9f25a7f11a2d499b0170bc3)
• Protoc: parser rejects explicit use of map_entry option (#13479) (https://github.com/protocolbuffers/protobuf/commit/8f5929230d5c5d117b84953463ef0da6d29ad36d)
• Protoc: validate that reserved range start is before end (#13474) (https://github.com/protocolbuffers/protobuf/commit/3be00f7638b9a61d2f0318ceac9d7d89d5af66b6)
• Protoc: support identifiers as reserved names in addition to string literals (only in editions) (#13471) (https://github.com/protocolbuffers/protobuf/commit/e701f4fa77620fc29109efc6902003d2cc93a30d)
• Drop support for Bazel 5. (https://github.com/protocolbuffers/protobuf/commit/a80daa2a2caaaac9ebe9ae6bb1b639c2771c5c55)
• Allow code generators to specify whether or not they support editions. (https://github.com/protocolbuffers/protobuf/commit/2176a145ba210c286177032037e736bf97158f7d)

C++

• Apply PROTOBUF_NOINLINE to declarations of some functions that want it. (https://github.com/protocolbuffers/protobuf/commit/6e848b00c95556d4f4fc7a1a512cd31a33de75d6)
• Implement proto2/proto3 with editions (https://github.com/protocolbuffers/protobuf/commit/3813b6622f6490b969c16e1b1ba7dcbd8f4e3209)
• Make JSON UTF-8 boundary check inclusive of the largest possible UTF-8 character. (https://github.com/protocolbuffers/protobuf/commit/e80b8ec620d71cdeca000dce835e5a167a8dc370)
• Reduce Map::size_type to 32-bits. Protobuf containers can't have more than (https://github.com/protocolbuffers/protobuf/commit/95d2b2ed5039c1b1606a5f8c9d9cb362a2a33c95)
• Defines Protobuf compiler version strings as macros and separates out suffix string definition. (https://github.com/protocolbuffers/protobuf/commit/3c59585bc116bee70f5f00a10005ea1403aef062)
• Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated oneof accessors. (https://github.com/protocolbuffers/protobuf/commit/e33e0d2ba569c8a7d6d74b5a8b39d804ec2a0169)
• Fix bug in reflection based Swap of map fields. (https://github.com/protocolbuffers/protobuf/commit/bef5b759f1fa511e3c08380a4e8635832d5d39fd)
• Add utf8_validation feature back to the global feature set. (https://github.com/protocolbuffers/protobuf/commit/153028d7f3029e066bb2287012e14417ca83d55c)
• Setting up version updater to prepare for poison pills and embedding version info into C++, Python and Java gencode. (https://github.com/protocolbuffers/protobuf/commit/4322e00e5b4c2f36016f0eee614e0e823a693ed4)
• Add prefetching to arena allocations. (https://github.com/protocolbuffers/protobuf/commit/fbdeb5af0b0f89dec79efc371ba75f838ffad2e8)
• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)
• Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated repeated and map field accessors. (https://github.com/protocolbuffers/protobuf/commit/9a0a3cf0cd8b4ac5c8a06db89f76c5d754f850d0)
• Editions: Migrate edition strings to enum in C++ code. (https://github.com/protocolbuffers/protobuf/commit/f083ebf21f56783fd838c006880f8e16e05d1f1e)
• Workaround ICE on gcc 7.5 by not having one overload call the other one with a (https://github.com/protocolbuffers/protobuf/commit/0522054f3ee5e32c9df15af7c11f046e91e77998)
• Create a reflection helper for ExtensionIdentifier. (https://github.com/protocolbuffers/protobuf/commit/4d5ab7324ef4d79eda69c8ed5bcb35f35e6db6f1)
• Editions: Provide an API for C++ generators to specify their features. (https://github.com/protocolbuffers/protobuf/commit/e897bcf3ff8004b7446bbe43a1fc28f9a92a11d4)
• Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated string field accessors. (https://github.com/protocolbuffers/protobuf/commit/18c338a699e7dfe85de014bf74cdf9c8a5ee155f)
• Editions: Refactor feature resolution to use an intermediate message. (https://github.com/protocolbuffers/protobuf/commit/57d8049b01b4bd95a1ca156eb375b523dc7d5d56)
• Fixes for 32-bit MSVC. (https://github.com/protocolbuffers/protobuf/commit/66cf6b1d9c22333a20d83ee02472e2e7162a8da6)
• Publish extension declarations with declaration verifications. (https://github.com/protocolbuffers/protobuf/commit/e72b0e181b236ff23c03a9f9f97f58e6989f25c9)
• Export the constants in protobuf's any.h to support DLL builds. (https://github.com/protocolbuffers/protobuf/commit/fd24b1bef4a5969ca1e1875e53e31f866e4b757b)
• Implement AbslStringify for the Descriptor family of types. (https://github.com/protocolbuffers/protobuf/commit/230232a041d7bce0080f459512ee2162ee9233e7)
• Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated message field accessors. (https://github.com/protocolbuffers/protobuf/commit/064035c0978516dceb64512e2e5fcf26aa2dedaa)
• Editions: Stop propagating partially resolved feature sets to plugins. (https://github.com/protocolbuffers/protobuf/commit/b66ef4c3f0af899e3736ad016259f9446f0adb14)
• Editions: Migrate string_field_validation to a C++ feature (https://github.com/protocolbuffers/protobuf/commit/1f9583069f0e2b11790ea36cc760ee371106f232)
• Editions: Include defaults for any features in the generated pool. (https://github.com/protocolbuffers/protobuf/commit/15863ffc9aff9d31e9f25a7f11a2d499b0170bc3)
• Introduce C++ feature for UTF8 validation. (https://github.com/protocolbuffers/protobuf/commit/c7119e6d56ea8e29f32ce5eb84fca82799095239)
• Protoc: validate that reserved range start is before end (#13474) (https://github.com/protocolbuffers/protobuf/commit/3be00f7638b9a61d2f0318ceac9d7d89d5af66b6)
• Remove option to disable the table-driven parser in protoc. (https://github.com/protocolbuffers/protobuf/commit/6d03f9b19bd7aa10d541f6c1a11ac71f2851eece)
• Lock down ctype=CORD in proto file. (https://github.com/protocolbuffers/protobuf/commit/b359e5020a68ce84faec5952100ae482e9eb0b1c)
• Support split repeated fields. (https://github.com/protocolbuffers/protobuf/commit/5b5e5bf5444f80033977d22024cf2dffd5d1c89b)
• In OSS mode omit some extern template specializations. We have seen reports of (https://github.com/protocolbuffers/protobuf/commit/ab968248b02842cf7733ba867cb6a53e680956c1)
• Automated rollback of commit adb2c4b415c35cda3e4394384ec579ea8dd8ec92. (https://github.com/protocolbuffers/protobuf/commit/0ea00526a11c405b342463cf75f40ca5753d4a0c)
• Allow code generators to specify whether or not they support editions. (https://github.com/protocolbuffers/protobuf/commit/2176a145ba210c286177032037e736bf97158f7d)
• Handle conflicting macros for FreeBSD (#13303) (https://github.com/protocolbuffers/protobuf/commit/2a952958eb1d4ea13fee2ad657a537ad443adf8f)

Java

• Implement proto2/proto3 with editions (https://github.com/protocolbuffers/protobuf/commit/3813b6622f6490b969c16e1b1ba7dcbd8f4e3209)
• Remove synthetic oneofs from Java gencode field accessor tables. (https://github.com/protocolbuffers/protobuf/commit/9ad2268544a345d9ed449e766999388b895d18a3)
• Timestamps.parse: Add error handling for invalid hours/minutes in the timezone offset. (https://github.com/protocolbuffers/protobuf/commit/8f8513835c0c4ebe206a5ead04a1bd0c8c7d1dbf)
• Defines Protobuf compiler version strings as macros and separates out suffix string definition. (https://github.com/protocolbuffers/protobuf/commit/3c59585bc116bee70f5f00a10005ea1403aef062)
• Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated oneof accessors. (https://github.com/protocolbuffers/protobuf/commit/e33e0d2ba569c8a7d6d74b5a8b39d804ec2a0169)
• Automated rollback of commit 2a55706f9d36afd1742c97fd0d611ea8af0ac3f8. (https://github.com/protocolbuffers/protobuf/commit/30b6251dea7a0ff1713a97d7e7d29a48e4880f59)
• Add missing debugging version info to Protobuf Java gencode when multiple files are generated. (https://github.com/protocolbuffers/protobuf/commit/301dfc5aebb37eee302beef408b6ba4b4eaf4425)
• Fix a bad cast in put<X>BuilderIfAbsent when already present due to using the result of put() directly (which is null if it currently has no value) (https://github.com/protocolbuffers/protobuf/commit/785c82dbdea5085628f2a41437aa1198860f3342)
• Setting up version updater to prepare for poison pills and embedding version info into C++, Python and Java gencode. (https://github.com/protocolbuffers/protobuf/commit/4322e00e5b4c2f36016f0eee614e0e823a693ed4)
• Fix a NPE in put<X>BuilderIfAbsent due to using the result of put() directly (which is null if it currently has no value) (https://github.com/protocolbuffers/protobuf/commit/47cec39ab36daf5264c2faf05d2ed4d0f48c1bc7)
• Update Kotlin compiler to escape package names (#13310) (https://github.com/protocolbuffers/protobuf/commit/437ec356fbe15d8737d797505aafb8e2b2629e7b)
• Add MapFieldBuilder and change codegen to generate it and the put{field}BuilderIfAbsent method. (https://github.com/protocolbuffers/protobuf/commit/955d4ab0d681d2bf60b481c1d066eee543ab1b8c)
• Introduce recursion limit in Java text format parsing (https://github.com/protocolbuffers/protobuf/commit/bca3bed137d013d4a654ffec52c0d44a3202aab2)
• Consider the protobuf.Any invalid if typeUrl.split("/") returns an empty array. (https://github.com/protocolbuffers/protobuf/commit/004f54af8f014c3e8a65db1b4459cfa70502e3ce)
• Mark FieldDescriptor.hasOptionalKeyword() as deprecated. (https://github.com/protocolbuffers/protobuf/commit/d6157f7c7ec78a6942cfd6d96d2e0b40e007ae0d)

Kotlin

• Add ByteString.isNotEmpty Kotlin extension function. (https://github.com/protocolbuffers/protobuf/commit/961779e164a8f8a015a44b082c01da2e1273b26c)

Csharp

• Add C# deterministic serialization (#13160) (https://github.com/protocolbuffers/protobuf/commit/96100bf1e49c5452f21e4446e43f5e7526f1351f)
• Add .NET debugging attributes (#14097) (https://github.com/protocolbuffers/protobuf/commit/67b9c76752b21c894bc8d7d59b3f6b2dc078c7b1)
• Improve .NET debugging of Protobuf messages (#13838) (https://github.com/protocolbuffers/protobuf/commit/e519c62f827a5f354c9253419c2fb5c230622311)
• Lock down ctype=CORD in proto file. (https://github.com/protocolbuffers/protobuf/commit/b359e5020a68ce84faec5952100ae482e9eb0b1c)

Objective-C

• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)
• [ObjC] Flip the default for two generation options. (https://github.com/protocolbuffers/protobuf/commit/08bbb577e8de8cd9afd56c6f78ab86418ef4bd4e)
• [ObjC] Enable generation of .proto files using editions. (https://github.com/protocolbuffers/protobuf/commit/55ab8316c14569cadc578e15ffdea4f1bcbb0964)
• [ObjC] add "generate_minimal_imports" generation option (https://github.com/protocolbuffers/protobuf/commit/0b817d46d4ca1977d3dccf2442aeee3c9e98e3a1)
• [ObjC] Add generation control for descriptor custom options. (https://github.com/protocolbuffers/protobuf/commit/bd9d6895c3d3f5f186d31b3e41bc0ad6af9d3129)
• Lock down ctype=CORD in proto file. (https://github.com/protocolbuffers/protobuf/commit/b359e5020a68ce84faec5952100ae482e9eb0b1c)

Rust

• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)

Python

• Loosen upb for json name conflict check in proto2 between json name and field (https://github.com/protocolbuffers/protobuf/commit/41af1d53a2d82ee17d6a3ac8a81ea2a93040ad82)
• Defines Protobuf compiler version strings as macros and separates out suffix string definition. (https://github.com/protocolbuffers/protobuf/commit/3c59585bc116bee70f5f00a10005ea1403aef062)
• Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated oneof accessors. (https://github.com/protocolbuffers/protobuf/commit/e33e0d2ba569c8a7d6d74b5a8b39d804ec2a0169)
• Ensure Timestamp.ToDatetime(tz) has correct offset (https://github.com/protocolbuffers/protobuf/commit/f0c56f9bc49b5015293eb5242a1982107b7c8b39)
• Do not check required field for upb python MergeFrom (https://github.com/protocolbuffers/protobuf/commit/1e0bc565a0f02b5f833f6057f13021a96a329eeb)
• Setting up version updater to prepare for poison pills and embedding version info into C++, Python and Java gencode. (https://github.com/protocolbuffers/protobuf/commit/4322e00e5b4c2f36016f0eee614e0e823a693ed4)
• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)
• Comparing a proto message with an object of unknown returns NotImplemented (https://github.com/protocolbuffers/protobuf/commit/12d4f418a7311ed4d381bf82caead11d03ae7911)
• Emit slots in pyi output as a tuple rather than a list for --pyi_out. (https://github.com/protocolbuffers/protobuf/commit/4a4f61589d3b258b5f1d2be752ff5dd01e7283d8)
• Fix a bug that strips options from descriptor.proto in Python. (https://github.com/protocolbuffers/protobuf/commit/27d42c5ba7ab65956e71b9d825f68ef84c38bbde)
• Raise warings for message.UnknownFields() usages and navigate to the new add (https://github.com/protocolbuffers/protobuf/commit/c988759a9bb5ce719721b6581d035c277b147db2)
• Add protobuf python keyword support in path for stub generator. Also added tests for (https://github.com/protocolbuffers/protobuf/commit/4cc258a6a1cb6d3e526e3ca2f6ab7748ee84e2e3)
• Add tuple support to set Struct (https://github.com/protocolbuffers/protobuf/commit/533fbbb45e666784a671aa9cb4ed5dd6a844a5a9)

Python C-Extension (Default)

• Comparing a proto message with an object of unknown returns NotImplemented (https://github.com/protocolbuffers/upb/commit/243add441169730acc42e6bad3a1a06a7f0b8e69)
• See also UPB changes below, which may affect Python C-Extension (Default).

PHP

• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)

Ruby

• Ruby FFI implementation (#13343) (https://github.com/protocolbuffers/protobuf/commit/c52d80cf04274aefd557e2bc93f64bb71c097645)

Ruby C-Extension

• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)
• Ruby: Fix object cache lookups on 32-bit platforms (#13494) (https://github.com/protocolbuffers/protobuf/commit/055c3782f6911822667157dab58341e44f9deedc)
• Ruby FFI implementation (#13343) (https://github.com/protocolbuffers/protobuf/commit/c52d80cf04274aefd557e2bc93f64bb71c097645)
• See also UPB changes below, which may affect Ruby C-Extension.

UPB (Python/PHP/Ruby C-Extension)

• Loosen upb for json name conflict check in proto2 between json name and field (https://github.com/protocolbuffers/protobuf/commit/41af1d53a2d82ee17d6a3ac8a81ea2a93040ad82)
• Add utf8_validation feature back to the global feature set. (https://github.com/protocolbuffers/protobuf/commit/153028d7f3029e066bb2287012e14417ca83d55c)
• Do not check required field for upb python MergeFrom (https://github.com/protocolbuffers/protobuf/commit/1e0bc565a0f02b5f833f6057f13021a96a329eeb)
• Merge the protobuf and upb Bazel repos (https://github.com/protocolbuffers/protobuf/commit/7286ffceb2f0a4489672a90c823e00425ab8ab5c)
• Cherry-pick recent changes from the upb repo (#13908) (https://github.com/protocolbuffers/protobuf/commit/b2e39c175a690ba76f1cf05ebb17f003f6bcd610)
• Added malloc_trim() calls to Python allocator so RSS will decrease when memory is freed (https://github.com/protocolbuffers/protobuf/commit/56e9f2b4e467a7df5989a61eec142df7c72ab796)
• Upb: fix a Python memory leak in ByteSize() (https://github.com/protocolbuffers/protobuf/commit/e45a6d50682d5d4b204e7d76254b1585b43c6815)
• Support ASAN detection on clang (#1424) (https://github.com/protocolbuffers/upb/commit/1b0011dfef3062ac25b0b2250c3140312b97fdf0)
• Upb: bugfix for importing a proto3 enum from within a proto2 file (https://github.com/protocolbuffers/upb/commit/b19edc5ce0b0dd6591e7b8f65430b0f3e3ea1c29)
• Expose methods needed by Ruby FFI using UPB_API (#1391) (https://github.com/protocolbuffers/upb/commit/01fed1cc1ba255bf22b49393ba054b8d270e6ba3)
• Fix PyUpb_Message_MergeInternal segfault (#1338) (https://github.com/protocolbuffers/upb/commit/cefa206f546ce36f895cd02ab5a7e8a1f6918a22)

Other

• Expose alias to protobuf_nowkt runtime (https://github.com/protocolbuffers/protobuf/commit/5b6c2459b57c23669d6efc5a14a874c693004eec)
• Update absl submodule and dep to latest 20230802.0 LTS (#13515) (https://github.com/protocolbuffers/protobuf/commit/e7bb34db3c57617f772a04d343a8bfa5109cf6cf)