Skip to content
This repository was archived by the owner on Oct 11, 2023. It is now read-only.

Including endpoints in saves for offsets - #30

Open
knordstrom wants to merge 58 commits into
Azure:developfrom
timeli-io:master
Open

Including endpoints in saves for offsets#30
knordstrom wants to merge 58 commits into
Azure:developfrom
timeli-io:master

Conversation

@knordstrom

@knordstrom knordstrom commented Jul 24, 2017

Copy link
Copy Markdown
Contributor

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)

I marked feature but neither really fit. Technically this is a third category, ie.

  • Breaking change that provides enhanced functionality

Description of the change

Offsets are now saved with a key that includes the IoTHub endpoint so that multiple IoTHubs may be tracked using the same datastore.

Motivation for the change

See discussion here #24


This change is Reviewable

Keith Nordstrom added 30 commits March 7, 2017 17:41
* Changed default namespace to an underscore-separated value
* private[iothubreact] Configuration object => (public) final class
* Configuration instance passed as implicit throughout application from IOTHub class, which establishes a default
* Added unit test for Configuration changes
* new test dependency on mockito
* styling
* reducing footprint throughout codebase of implicit config
* trait based DI
* Changed default namespace to an underscore-separated value
* private[iothubreact] Configuration object => (public) final class
* Configuration instance passed as implicit throughout application from IOTHub class, which establishes a default
* Added unit test for Configuration changes
* new test dependency on mockito
* styling
* reducing footprint throughout codebase of implicit config
* trait based DI
* Changed default namespace to an underscore-separated value
* private[iothubreact] Configuration object => (public) final class
* Configuration instance passed as implicit throughout application from IOTHub class, which establishes a default
* Added unit test for Configuration changes
* new test dependency on mockito
* styling
* reducing footprint throughout codebase of implicit config
* trait based DI
Removing a default in favor of an implicit test declaration


Conflicts:
	build.sbt
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/cassandra/lib/Connection.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/javadsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHubPartition.scala
	src/test/scala/api/API.scala
* CheckpointService config abstracted for usage multiple places
* Offset commit sink added
* added to integration test, though not yet directly tested in this project
Conflicts:
	README.md
	build.sbt
	samples-java/pom.xml
	samples-scala/src/main/scala/A_APIUSage/Demo.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/MessageToDevice.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/Backends/cassandra/lib/Auth.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CPConfiguration.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CheckpointService.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/AzureBlob.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/CassandraTable.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/CheckpointBackend.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/cassandra/lib/Connection.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/javadsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHubPartition.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/sinks/MessageToDeviceSink.scala
	src/test/scala/api/API.scala
Keith Nordstrom and others added 27 commits May 15, 2017 19:45
* named magic number in scala example app
* formatting fix
…s are hashed in the storage backend. Some refactoring and additional DI included to support a test.
Conflicts:
	CHECKPOINTING.md
	README.md
	build.sbt
	samples-java/src/main/java/DisplayMessagesWithAcknowledgement/Main.java
	samples-java/src/main/java/SendMessageToDevice/Main.java
	samples-scala/src/main/scala/A_APIUSage/Demo.scala
	samples-scala/src/main/scala/E_Checkpoints/Demo.scala
	samples-scala/src/main/scala/OSN/Demo3_Checkpoints.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/SourceOptions.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CheckpointOnPull.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CheckpointService.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/OffsetLoader.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/cassandra/CheckpointRecord.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/config/ConnectConfiguration.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/javadsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHubPartition.scala
	src/test/scala/api/API.scala
	src/test/scala/com/microsoft/azure/iot/iothubreact/SourceOptionsTest.scala
	src/test/scala/com/microsoft/azure/iot/iothubreact/checkpointing/OffsetLoaderTest.scala
	src/test/scala/it/AllIoTDeviceMessagesAreDelivered.scala
@knordstrom

Copy link
Copy Markdown
Contributor Author

Sorry about the long delay, there were other things that took me away for a bit. It looks to me like this was ready but the hashing we agreed to in the discussion was not implemented. Is that accurate or was there something else?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants