用于连接到雪花数据的 HAProxy 设置



我一直在尝试通过代理使用 ODBC 驱动程序连接到雪花,但到目前为止无法做到。我正在使用HAProxy来做到这一点。

这是来自odbc.ini,我在其中配置了我的 DSN:

[ODBC Data Sources]
SnowflakeDSII = Snowflake
[SnowflakeDSII]
Server = <account>.<region>.snowflakecomputing.com
Port = 443
UID = <username>
PWD = <password>
Schema =
Warehouse =
Driver = /opt/snowflake/snowflakeodbc/lib/universal/libSnowflake.dylib
Description = Snowflake DSII
Locale = en-US
Tracing = 0
proxy = http://127.0.0.1:8000

这是我的HAProxy配置:

global
log stdout format raw local0 info
defaults
log global
# timeouts
timeout connect 3600s
timeout client 3600s
timeout server 3600s
maxconn 4000
frontend snowflake_proxy
mode tcp
option tcplog
bind 0.0.0.0:8000
default_backend snowflake
backend snowflake
mode tcp
option tcp-check
server server0 <account>.<region>.snowflakecomputing.com:443 check

在运行iodbctest时,我看到此错误:

OOB curl_easy_perform() failed: Failure when receiving data from the peer
1: SQLDriverConnect = [Snowflake][Snowflake] (4)
REST request for URL https://<account>.<region>.snowflakecomputing.com:443/session/v1/login-request?requestId=0fe536ed-4d6c-4858-b468-52a6757248a7&request_guid=5477913c-989a-4da3-bbbc-b62a68391749 failed: CURLerror (curl_easy_perform() failed) - code=56 msg='Failure when receiving data from the peer' osCode=36 osMsg='Operation now in progress'.
(4) SQLSTATE=HY000
1: ODBC_Connect = [Snowflake][Snowflake] (4)
REST request for URL https://<account>.<region>.snowflakecomputing.com:443/session/v1/login-request?requestId=0fe536ed-4d6c-4858-b468-52a6757248a7&request_guid=5477913c-989a-4da3-bbbc-b62a68391749 failed: CURLerror (curl_easy_perform() failed) - code=56 msg='Failure when receiving data from the peer' osCode=36 osMsg='Operation now in progress'.
(4) SQLSTATE=HY000

我还尝试将HAProxy配置为一个简单的HTTP代理。这是我的HAProxy配置:

global
log stdout format raw local0 info
defaults
log global
# timeouts
timeout connect 3600s
timeout client 3600s
timeout server 3600s
maxconn 4000
frontend snowflake_proxy
mode http
option httplog
bind 0.0.0.0:8000
default_backend snowflake
backend snowflake
mode http
option http-server-close
option http_proxy

使用上面的 HAProxy 配置,我看到此错误:

OOB curl_easy_perform() failed: Failure when receiving data from the peer
1: SQLDriverConnect = [Snowflake][Snowflake] (4)
REST request for URL https://<account>.<region>.snowflakecomputing.com:443/session/v1/login-request?requestId=01ccf8d9-895b-47d1-9102-41f7524ec436&request_guid=773e75b3-9137-4862-a5e1-3bf49e076a1d failed: CURLerror (curl_easy_perform() failed) - code=56 msg='Failure when receiving data from the peer'.
(4) SQLSTATE=HY000
1: ODBC_Connect = [Snowflake][Snowflake] (4)
REST request for URL https://<account>.<region>.snowflakecomputing.com:443/session/v1/login-request?requestId=01ccf8d9-895b-47d1-9102-41f7524ec436&request_guid=773e75b3-9137-4862-a5e1-3bf49e076a1d failed: CURLerror (curl_easy_perform() failed) - code=56 msg='Failure when receiving data from the peer'.
(4) SQLSTATE=HY000

来自HAProxy的日志:

127.0.0.1:64824 [31/Jan/2020:13:28:19.888] snowflake_proxy snowflake/<NOSRV> -1/-1/-1/-1/0 400 211 - - PR-- 1/1/0/0/3 0/0 "CONNECT <account>.<region>.snowflakecomputing.com:443 HTTP/1.1"
127.0.0.1:64825 [31/Jan/2020:13:28:21.890] snowflake_proxy snowflake/<NOSRV> -1/-1/-1/-1/0 400 211 - - PR-- 1/1/0/0/3 0/0 "CONNECT <account>.<region>.snowflakecomputing.com:443 HTTP/1.1"
127.0.0.1:64826 [31/Jan/2020:13:28:25.894] snowflake_proxy snowflake/<NOSRV> -1/-1/-1/-1/0 400 211 - - PR-- 1/1/0/0/3 0/0 "CONNECT <account>.<region>.snowflakecomputing.com:443 HTTP/1.1"
127.0.0.1:64829 [31/Jan/2020:13:28:33.898] snowflake_proxy snowflake/<NOSRV> -1/-1/-1/-1/0 400 211 - - PR-- 1/1/0/0/3 0/0 "CONNECT <account>.<region>.snowflakecomputing.com:443 HTTP/1.1"
127.0.0.1:64830 [31/Jan/2020:13:28:33.903] snowflake_proxy snowflake/<NOSRV> -1/-1/-1/-1/0 400 211 - - PR-- 1/1/0/0/3 0/0 "CONNECT sfctest.client-telemetry.snowflakecomputing.com:443 HTTP/1.1"

有没有人运气做类似的事情?你能分享你的HAProxy配置的相关部分吗?

由于需要在代理上配置 SSL 直通,HAProxy 可能很难(如果不是不可能的话(配置并用作 Snowflake 的 ODBC 驱动程序的转发代理。

原因在这个SO答案中陈述:

我捕获了数据包,使用代理访问一个https网站,curl会启动一个HTTP CONNECT方法来建立隧道。隧道应该在curl客户端和代理之间,但TCP代理会将所有消息传递到Web服务器,因此Web服务器将重置连接。

转发代理不应只在客户端和 Web 服务器之间传递消息。它应该理解HTTP CONNECT方法

HAProxy 在执行 SSL 直通时表现为 TCP 代理,因此不会解析底层消息。但是,在这样做之前,它需要先设置隧道,这需要响应 HTTPCONNECT方法。

最新更新