You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 16 Next »

To be Reviewed By: March 11, 2020

Authors: Dan Smith, Ernie Burghardt

Status: Draft | Discussion | Active | Dropped | Superseded

Superseded by: N/A

Related: GEODE-7852

Problem

Users would like to be able to put Geode servers behind a proxy. This would allow users to avoid having to allocate public IP addresses for all of the servers, as well as being able to control and monitor access to the servers.

Currently, this is not very well supported. Geode clients discover servers using locators. It is possible to set the hostname-for-clients on all servers to point to the proxy server, but this is not ideal. Geode clients rely on being able to connect to specific  servers for features like PR single hop and client server queues. This means that the clients need a protocol that will allow them to tell the proxy which server they connect to.

Anti-Goals

  • It is an anti-goal to deal with configuring the proxy itself.
  • It is an anti-goal to support all different kinds of proxies. In the future we may consider supporting other types of proxies, but this proposal is to support one specific type - a SNI proxy.
  • We're not recommending any specific SNI proxy
  • This proposal does not include supporting a proxy for WAN or P2P connectivity. In the future we may add support for that as well.

Solution

We will add a way for the user to set a SNI proxy for the client to connect to the servers through. When this option is set, all connections from the client to the locator or the servers will use this SNI proxy. When configuring a Pool, the names of the locators or the names of the servers provided in the pool configuration will be passed as the Server Name Indicator field when the client connects to the proxy. The proxy must be able to resolve these names and connect to the correct locator or server.

This setting ideally should be at a pool level, because different pools may need to use different proxies.

To make it as easy as possible for users to extend our proxy implementation logic or implement their own, we will introduce a more general pool setting which will allow the users to override the creation of client server sockets with a custom SocketFactory. We will provide an implementation of this SocketFactory that will connect their client to an SNI proxy.

The way to configure the SNI proxy will therefore look something like this:

 


Below are the details on the new methods and interfaces added to the API to support this

Modified classes:

PoolFactory {    
  /**
   * Set the socket factory used by this pool to create connections to both locators (if
   * configured using {@link #addLocator(String, int)}) and servers.
   *
   * Sockets returned by this factory will have the rest of the configuration options
   * specified on this pool and on the {@link ClientCache} applied to them. In particular,
   * sockets returned by this factory will be wrapped with SSLSockets if ssl is enabled
   * for this client cache.
   *
   * This factory can be used for configuring a proxy, or overriding various socket settings.
   * For modifying SSL settings, see {@link SSLParameterExtension}
   *
   * See {@link Proxies}
   *
   * @param socketFactory The {@link SocketFactory} to use
   * @return a reference to <code> this </code>
   * @since Geode 1.13
   */
  PoolFactory setSocketFactory(SocketFactory socketFactory);
}

ClientCacheFactory {
  /**
   * (see description of PoolFactory above)
   */
  setPoolSocketFactory(SocketFactory socketFactory)
}


New classes

package org.apache.geode.cache.client;
public interface SocketFactory {
  /**
   * Create a (unconnected) tcp socket for establishing a client.
   */
Socket createSocket() throws IOException;
}
package org.apache.geode.cache.client.proxy;
public class SniSocketFactory implements SocketFactory {
...
}

public class Proxies {
   public static SocketFactory sni(String hostname, int port)  
}


Performance Impact

Connecting through a proxy may impact the performance of client/server messaging, but it is up to the user to decide if they want to use this feature or not. SNI proxies do require the use of TLS, which also adds overhead.

Backwards Compatibility and Upgrade Path

This is a client side setting, so there should be no backwards compatibility or upgrade concerns.

One concern with this SocketFactory approach is that is including the use of blocking, Java 1.0 sockets in the API. If, in the future we try to upgrade the internals of the client to use SocketChannel or netty or rsocket, we will have a difficult time continuing to support this SocketFactory API and may break users custom SocketFactory implementations.

Prior Art

Alternative ways to introduce a proxy would be:

  • Set the hostname-for-clients to point to the proxy. However this does not let the client connect to specific servers, because from the client's point of view there is only one server (the proxy). This makes client single hop no longer functional. It also makes it hard for the client to maintain redundancy of server to client queues, for subscriptions.
  • Use a SOCKS5 proxy instead.


Geode also added support to set the SNI field in the client hello as part of GEODE-7414. With those changes, a user can provide a SSLParameterExtension callback that can modify any of the SSLParameters, including the SNI server name. If a proxy of type SNI is set and the SSLParameterExtension is also set, the SSLParameterExtension will run after geode has set the SNI name, and can potential modify it.

FAQ

Is this platform specific?

  • No this feature is intended to be platform agnostic.

Does this require a firewall?

  • This is an implementation detail that will be left to the users discretion.


Errata

What are minor adjustments that had to be made to the proposal since it was approved?


References

[1] Description of URL syntax from Wikipedia article on URLs https://en.wikipedia.org/wiki/URL#Syntax

[2] RFC 3986 sections 3.2.2 and 3.2.3 describing host and port syntax in URLs https://tools.ietf.org/html/rfc3986#section-3.2.2

  • No labels