Alpakka sample

Fetch CSV via Akka HTTP and publish the data as JSON to Kafka

This example uses Akka HTTP to send the HTTP request and Akka HTTPs primary JSON support via Spray JSON (for Scala) or Jackson JSON (for Java) to convert the map into a JSON structure which gets published to a Kafka topic.

Browse the sources at Github.

To try out this project clone the Alpakka Samples repository and find it in the alpakka-sample-http-csv-to-kafka directory.

Dependencies

Dependencies
sourceval ScalaTestVersion = "3.1.4"
val AkkaVersion = "2.7.0"
val AkkaHttpVersion = "10.4.0"
val AlpakkaVersion = "6.0.1"
val AlpakkaKafkaVersion = "4.0.0"
val AkkaDiagnosticsVersion = "2.0.0-M4"

val dependencies = List(
  "com.lightbend.akka" %% "akka-stream-alpakka-csv" % AlpakkaVersion,
  "com.typesafe.akka" %% "akka-stream-kafka" % AlpakkaKafkaVersion,
  "com.typesafe.akka" %% "akka-actor-typed" % AkkaVersion,
  "com.typesafe.akka" %% "akka-stream" % AkkaVersion,
  "com.typesafe.akka" %% "akka-http" % AkkaHttpVersion,
  "com.lightbend.akka" %% "akka-diagnostics" % AkkaDiagnosticsVersion,
  // Used from Scala
  "com.typesafe.akka" %% "akka-http-spray-json" % AkkaHttpVersion,
  // Used from Java
  "com.fasterxml.jackson.datatype" % "jackson-datatype-jdk8" % "2.11.4",
  "com.fasterxml.jackson.datatype" % "jackson-datatype-jsr310" % "2.11.4",

  "org.testcontainers" % "kafka" % "1.14.3",
  
  "com.typesafe.akka" %% "akka-slf4j" % AkkaVersion,
  "ch.qos.logback" % "logback-classic" % "1.2.3"
)

All Alpakka samples

Show Alpakka samples listing.

Found an error in this documentation? The source code for this page can be found here. Please feel free to edit and contribute a pull request.