Status

Current state: "Under Discussion"

...

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

Motivation

In the new dynamic routing feature, there is no (easy) way to get back the topic name that the Sink writes to if it uses dynamic routing. By adding topicNameExtractor any client of a Sink node can get the class of the TopicNameExtractor used to extract the final topic that the Sink writes to.

The original intention of TopologyDescription was to allow users to perform runtime checking. However, large number of users have opted to print or parse the textual representation of the Topology for convenience instead. The problem is the current TopologyDescription relies too heavily on String to represent the Source and Sink Nodes. By returning the underlying object and overriding toString(), users can still leverage TopologyDescription for runtime checks while also preserving the human readable representations of the Topology.

Public Interface

The underlying object for a Source node in TopologyDescription is set of topics or a pattern to match source topics on. Similarly, the underlying of object a Sink node is either the final topic if it is statically determined or the TopicNameExtractor used to the determine the topic. 

...

public interface TopologyDescription {
	// Other interfaces and variables within TopologyDescription are not shown here.

	interface Source extends Node {

	    Set<String> topics();

   		Pattern topicPattern();
	}	

	interface Sink extends Node {
	    String topic();

		// Add abstract method to return the TopicNameExtractor class in situations where dynamic routing is used.
		// Otherwise, return null.
    	Class<? extends TopicNameExtractor> TopicNameExtractor topicNameExtractor();
	}
}

Proposed Changes

Add the above interface change and add the following to InternalTopologyBuilder.java.

@Override
public Class<?final static class Source extends AbstractNode TopicNameExtractor> topicNameExtractor()implements TopologyDescription.Source {
	// Other methods  if (topicNameExtractor instanceof StaticTopicNameExtractor)and variables are not shown here
	@Override
	public Set<String> topics() {
    	return topics;
	}

	@Override
	public Pattern topicPattern() {
    	return null;
    else
        return topicNameExtractor.getClass();
}

...

topicPattern;
	}
}


public final static class Sink extends AbstractNode implements TopologyDescription.Sink {
	// Other methods and variables are not shown here


	// Output the topic name if dynamic routing is not used. Otherwise, output the toString value of the TopicNameExtractor.
	@Override
	public TopicNameExtractor topicNameExtractor() {
    	if (topicNameExtractor instanceof StaticTopicNameExtractor) {
        	return null;
 		} else {
        	return topicNameExtractor;
		}
	}
}

Compatibility, Deprecation, and Migration Plan

No known compatibility issues.

Rejected Alternatives