Kafka.Protocol 2.0.0-pre-137

• .NETStandard 2.1

  • Log.It (>= 3.0.3)
  • System.IO.Pipelines (>= 4.5.3)

# [v2.0.0-pre-137](https://github.com/Fresa/Kafka.Protocol/compare/v1.0.0...v2.0.0-pre-137) (2022-01-19)


### Bug Fixes

* **request payload:** exceptions thrown when reading a request payload should not be hidden by the stream length reporter throwing because all data has not been read ([6b6975b](https://github.com/Fresa/Kafka.Protocol/commit/6b6975bb6e6367ac91fafd83dcbbb8899de4172e))
* nullable default fields ([d51e522](https://github.com/Fresa/Kafka.Protocol/commit/d51e52297f8a52d2c70118b0d1126bce08a735b2))
* **reader:** when there is less than expected bytes read the reader is not informed that the data has been inspected which is mandatory. Refactor to use an array buffer writer instead to continuesly write to ([14f93fe](https://github.com/Fresa/Kafka.Protocol/commit/14f93fe3360c3777efc93fbdb38c183dd7049ba8))
* add nullability check when transforming nullable maps to dictionaries to avoid null reference exceptions ([d730dcc](https://github.com/Fresa/Kafka.Protocol/commit/d730dcc4bd7ae68b19f0a9f65aa78714d4a0ce00))
* **message definitions:** remove old definitions before downloading new ([63b3bb5](https://github.com/Fresa/Kafka.Protocol/commit/63b3bb543c7df531af56299ea0a7559fcb6c65a5))
* incorrect syntax of the conditional operator for reading compactated fields ([08585b9](https://github.com/Fresa/Kafka.Protocol/commit/08585b983187a87579e1c964f8b1a360388c152f))
* **crc:** CRC comparison was incorrect and calculating the CRC when reading was ineffeciently implemented ([34c5730](https://github.com/Fresa/Kafka.Protocol/commit/34c5730508f8e46324a2edefc2f496f8c953ad96))
* **records:** record and record batches read and wrote incorrect payload sizes ([958065d](https://github.com/Fresa/Kafka.Protocol/commit/958065d3c7e4555bc9d8e3fcc35c371b40f674dd))


### Code Refactoring

* **serialization:** move serialization to primitives and structures ([88e752d](https://github.com/Fresa/Kafka.Protocol/commit/88e752d2fe8aa8d6260b0c3f4a91b69db563f0e4))
* change to private setters for properties as most structures are not instantiable anyway due to internal logic. With methods should be used. ([2e80b38](https://github.com/Fresa/Kafka.Protocol/commit/2e80b387fa49bc8fb1979d71b8704a7ad0d6bb89))
* internalize serialization ([a86d928](https://github.com/Fresa/Kafka.Protocol/commit/a86d92873b5ea1f72158a93e15f5f4049a44d61f))


### Features

* **crc:** check for data corruption in records ([409ed50](https://github.com/Fresa/Kafka.Protocol/commit/409ed502b3eb25377905803b7c92cd9a7fa0abe5))
* **definitions:** update to latest protocol definition ([e8ae06d](https://github.com/Fresa/Kafka.Protocol/commit/e8ae06d8bfde80ee6a4c8ccbda7b3f8cf480aad2))
* **definitions:** update with the latest message deffinitions ([40b965a](https://github.com/Fresa/Kafka.Protocol/commit/40b965a59c2babb9be8b2dab6909477c4312bf35))
* **flexible versions:** support serializing flexible messages ([6d95901](https://github.com/Fresa/Kafka.Protocol/commit/6d9590167f696520e8f1391069a16533ade7a1c3))
* **tagged field:** support tagged (optional) fields ([145ffdf](https://github.com/Fresa/Kafka.Protocol/commit/145ffdf92b02d827320c7d2eb0effecb413715c0))


### Reverts

* Revert Revert add nullable record batch ([a567b68](https://github.com/Fresa/Kafka.Protocol/commit/a567b68177c24f48764c78b776535121a07acd3a))
* Revert determine if a primitive type can be compatable and use that when calculating size ([0a2b89f](https://github.com/Fresa/Kafka.Protocol/commit/0a2b89fed1a16a714c621aec2292446ac637c5f0))
* Revert add implicit convertion operators for compact primitves ([b7eddd3](https://github.com/Fresa/Kafka.Protocol/commit/b7eddd345984a49c7b4b0ee9968fbbb3b02db275))
* Revert split compaction into separate structs ([b33022c](https://github.com/Fresa/Kafka.Protocol/commit/b33022c03e0140e58461bb6c67c74cf6690696f3))


### Tests

* **recordbatch:** assure the length is correctly written ([7058687](https://github.com/Fresa/Kafka.Protocol/commit/70586877ea681b083351064022afd06215b19b92))


### BREAKING CHANGES

* **crc:** Records and record headers have been simplified and some redundant fields have been removed like key and value length. Records have also been updated to match latest protocol specification.
* **recordbatch:** refactored attribtutes to use an enum instead of properties to set timestamp type and compression
* **message definitions:** ListOffsetResponse and ListOffsetRequest have changed name to ListOffsetsResponse and ListOffsetsRequest
* **serialization:** IKafkaReader has been exchange to it's underlaying native PipeReader and IKafkaWriter has been exchange to it's underlying Stream. This should not affect most as it is mostly an internal mechanism.
* use with-methods instead of property setters
* serialization/deserialization should only be called from the request/response payload object. Any other usage from other protocol structures is now internal.