https://github.com/SpringSource/spring-xd

Build: #2236 failed Changes by 3 people

Code commits

Git

  • Marius Bogoevici <mbogoevici@pivotal.io>

    Marius Bogoevici <mbogoevici@pivotal.io> 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22

    XD-2996: Align Kafka Partitioning/XD Partitioning
    JIRA: XD-2996">https://jira.spring.io/browse/XD-2996

    Align transport native partitioning with Spring XD partitioning

    - Eliminate the `partitionCount` property, which is currently just a copy of `count`, as well as its calculation;
    - Propagate `nextModuleCount` and `nextModuleConcurrency` to all non-last modules;
    - Make the target partition count an argument for the construction of `PartitioningMetadata`, and defer to the transport-specific implementation to decide on the value to be used: Redis and Rabbit will simply use `nextModuleCount`, and Kafka will use the partition count of the target topic;
    - the number of the partitions used by the Kafka bus is the larger of `minPartitionCount` and `nextModuleConcurrency` * `nextModuleCount`, unless a topic exists and already has more partitions than either of the two values, case in which the number of existing partitions will be used;
    - eliminate the additional calculation in the Kafka bus, which was required because the number of Spring XD partitions, could have been, in principle, different from the number of underlying Kafka partitions;
    - unit tests adjustments;

    • spring-xd-dirt/src/main/java/org/springframework/xd/dirt/server/admin/deployment/StreamRuntimePropertiesProvider.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-dirt/src/test/java/org/springframework/xd/dirt/integration/bus/PartitionCapableBusTests.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-dirt/src/test/java/org/springframework/xd/dirt/integration/bus/kafka/KafkaMessageBusTests.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-dirt/src/test/java/org/springframework/xd/dirt/integration/bus/kafka/RawModeKafkaMessageBusTests.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-dirt/src/test/java/org/springframework/xd/dirt/integration/bus/rabbit/RabbitMessageBusTests.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-dirt/src/test/java/org/springframework/xd/dirt/integration/bus/redis/RedisMessageBusTests.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-messagebus-kafka/src/main/java/org/springframework/xd/dirt/integration/kafka/KafkaMessageBus.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-messagebus-rabbit/src/main/java/org/springframework/xd/dirt/integration/rabbit/RabbitMessageBus.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-messagebus-redis/src/main/java/org/springframework/xd/dirt/integration/redis/RedisMessageBus.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-messagebus-spi/src/main/java/org/springframework/xd/dirt/integration/bus/AbstractBusPropertiesAccessor.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-messagebus-spi/src/main/java/org/springframework/xd/dirt/integration/bus/BusProperties.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
    • spring-xd-messagebus-spi/src/main/java/org/springframework/xd/dirt/integration/bus/MessageBusSupport.java (version 2180cdcf5537ba8cc763f71ab8245ef6be7fbe22)
  • Gunnar Hillert

    Gunnar Hillert 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad

    XD-3112 Mask passwords in stream defs/modules
    * Mask passwords when returning streams via the REST-API
    * Add test

    XD-3112 Fix tests

    XD-3112 Add password masking for `/runtime/modules`

    • spring-xd-dirt/src/main/java/org/springframework/xd/dirt/rest/ModulesMetadataController.java (version 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad)
    • spring-xd-dirt/src/main/java/org/springframework/xd/dirt/rest/PasswordUtils.java (version 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad)
    • spring-xd-dirt/src/main/java/org/springframework/xd/dirt/rest/StreamsController.java (version 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad)
    • spring-xd-dirt/src/test/java/org/springframework/xd/dirt/rest/PasswordUtilsTests.java (version 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad)
    • spring-xd-shell/src/test/java/org/springframework/xd/shell/command/JarDeletingModuleCommandTests.java (version 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad)
    • spring-xd-shell/src/test/java/org/springframework/xd/shell/command/StreamCommandTemplate.java (version 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad)
    • spring-xd-shell/src/test/java/org/springframework/xd/shell/command/StreamCommandTests.java (version 70866a5fed9c6abcdda33cb05e5ab7a09cfa40ad)
  • Eric Bottard

    Eric Bottard 06863c3a54625ecd2c125369572f1ad6561efcb3

    XD-3116: Update bundled redis to 3.0.1

    • .gitignore (version 06863c3a54625ecd2c125369572f1ad6561efcb3)
    • redis/dist/redis-2.8.3.tar.gz (version 06863c3a54625ecd2c125369572f1ad6561efcb3)
    • redis/dist/redis-3.0.1.tar.gz (version 06863c3a54625ecd2c125369572f1ad6561efcb3)
    • scripts/redis/install-redis (version 06863c3a54625ecd2c125369572f1ad6561efcb3)
    • src/docs/asciidoc/Running-Distributed-Mode.asciidoc (version 06863c3a54625ecd2c125369572f1ad6561efcb3)