Spring Cloud Data Flow Samples

Build: #19 was successful Changes by David Turanski <dturanski@pivotal.io>

Stages & jobs

  1. Default Stage

  2. Build Module Launcher Docker Image and upload

Code commits

Git

  • David Turanski <dturanski@pivotal.io>

    David Turanski <dturanski@pivotal.io> 699f7856e472392ba2a977dd950357bdc8cc9f4b

    Main File Ingest Demo written
    * Add Concurrent Execution Limit
    * Add Avoid Duplicate Processing
    * Update link
    * Add snapshot repo
    * Update copyright year
    * Finish Metadata Store sample and reduce number of split files to 20
    * Add Cloud Foundry MetadataStore

    • src/main/asciidoc/tasks/file-ingest/main.adoc (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/streaming/cassandra/http-to-cassandra/pcf.adoc (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/index.adoc (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/index-docinfo.xml (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/images/people_table_2.png (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/images/people_table_1.png (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/images/metadata_store_1.png (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/batch/file-ingest-sftp/pcf.adoc (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/batch/file-ingest-sftp/main.adoc (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • src/main/asciidoc/batch/file-ingest-sftp/local.adoc (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • pom.xml (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/src/test/java/io/spring/cloud/dataflow/ingest/config/BatchConfigurationTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/src/test/java/io/spring/cloud/dataflow/ingest/BatchApplicationTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/src/main/resources/schema-all.sql (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/src/main/resources/application.properties (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/src/main/java/io/spring/cloud/dataflow/ingest/config/BatchConfiguration.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/src/main/java/io/spring/cloud/dataflow/ingest/Application.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/pom.xml (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_at.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_as.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ar.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_aq.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ap.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ao.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_an.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_am.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_al.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ak.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_aj.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ai.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ah.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ag.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_af.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ae.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ad.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ac.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_ab.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/split/names_aa.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/name-list.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest/data/README.md (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/test/java/org/springframework/ingest/processor/PersonItemProcessorTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/test/java/org/springframework/ingest/mapper/fieldset/PersonFieldSetMapperTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/test/java/org/springframework/ingest/config/BatchConfigurationTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/resources/schema-all.sql (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/resources/application.properties (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/resource/sftp/SftpRemoteResource.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/resource/RemoteResource.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/processor/PersonItemProcessor.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/mapper/fieldset/PersonFieldSetMapper.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/domain/Person.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/config/BatchConfigurationProperties.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/config/BatchConfiguration.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/src/main/java/org/springframework/ingest/Application.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/pom.xml (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp/data/people.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/test/resources/schema-all.sql (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/test/java/org/springframework/ingest/processor/PersonItemProcessorTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/test/java/org/springframework/ingest/mapper/fieldset/PersonFieldSetMapperTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/test/java/org/springframework/ingest/config/BatchConfigurationTests.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/resources/schema-all.sql (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/resources/application.properties (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/resource/sftp/SftpRemoteResource.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/resource/RemoteResource.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/processor/PersonItemProcessor.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/mapper/fieldset/PersonFieldSetMapper.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/domain/Person.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/config/BatchConfigurationProperties.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/config/BatchConfiguration.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/src/main/java/org/springframework/ingest/Application.java (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/pom.xml (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/data/people.csv (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)
    • batch/file-ingest-sftp-cf/artifacts/ingest-sftp-cf-1.0.0.jar (version 699f7856e472392ba2a977dd950357bdc8cc9f4b)