Skip to content

ERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1:4007' (61) #158

Description

@Willendless

When following the instructions to run copr-test locally, I fail to connect tidb (WithPushDown)

...
...
+ Launching TiDB for WithPushDown test using config /Users/lijiarui/Works/pingcap/internship/tikv-test/copr-test/push-down-test/build/config/with_push_down/tidb.toml

  - Config content:
port = 4007
store = "tikv"
path = "127.0.0.1:4479"
socket = ""

[status]
report-status = false
  - Starting process...
/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/bin/tidb-server -config /Users/lijiarui/Works/pingcap/internship/tikv-test/copr-test/push-down-test/build/config/with_push_down/tidb.toml -log-file /Users/lijiarui/Works/pingcap/internship/tikv-test/copr-test/push-down-test/build/tidb_with_push_down.log -L warn
  - Sleep 10s to wait for TiDB to start

+ Waiting TiDB start up (NoPushDown)
+--------------------+
| Database           |
+--------------------+
| INFORMATION_SCHEMA |
| METRICS_SCHEMA     |
| PERFORMANCE_SCHEMA |
| mysql              |
| test               |
+--------------------+
  - TiDB startup successfully (NoPushDown)

+ Waiting TiDB start up (WithPushDown)
ERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1:4007' (61)
ERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1:4007' (61)
ERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1:4007' (61)

// pd log

[2022/07/17 20:16:12.722 -04:00] [WARN] [server.go:298] ["exceeded recommended request limit"] [max-request-bytes=157286400] [max-request-size="157 MB"] [recommended-request-bytes=1$
[2022/07/17 20:16:12.913 -04:00] [WARN] [store.go:1317] ["simple token is not cryptographically signed"]
[2022/07/17 20:16:12.992 -04:00] [WARN] [metrics.go:193] ["failed to get file descriptor usage"] [error="cannot get FDUsage on darwin"]
[2022/07/17 20:16:13.785 -04:00] [FATAL] [versioninfo.go:57] ["version string is illegal"] [error="[PD:semver:ErrSemverNewVersion]51ad29c is not in dotted-tri format: 51ad29c is not$

// tidb log

...
...
 100 [2022/07/17 20:17:56.024 -04:00] [WARN] [base_client.go:251] ["[pd] failed to get cluster id"] [url=http://127.0.0.1:4479] [error="[PD:client:ErrClientGetMember]error:rpc            error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\" target:127.0.0.1:4479 status:       TRANSIENT_FAILURE: error:rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\"        target:127.0.0.1:4479 status:TRANSIENT_FAILURE"]
 101 [2022/07/17 20:17:57.029 -04:00] [WARN] [base_client.go:251] ["[pd] failed to get cluster id"] [url=http://127.0.0.1:4479] [error="[PD:client:ErrClientGetMember]error:rpc            error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\" target:127.0.0.1:4479 status:       TRANSIENT_FAILURE: error:rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\"        target:127.0.0.1:4479 status:TRANSIENT_FAILURE"]
 102 [2022/07/17 20:17:58.034 -04:00] [WARN] [base_client.go:251] ["[pd] failed to get cluster id"] [url=http://127.0.0.1:4479] [error="[PD:client:ErrClientGetMember]error:rpc            error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\" target:127.0.0.1:4479 status:       TRANSIENT_FAILURE: error:rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\"        target:127.0.0.1:4479 status:TRANSIENT_FAILURE"]
 103 [2022/07/17 20:17:59.035 -04:00] [WARN] [store.go:82] ["new store with retry failed"] [error="[pd] failed to get cluster id"]
 104 [2022/07/17 20:17:59.035 -04:00] [FATAL] [terror.go:298] ["unexpected error"] [error="[pd] failed to get cluster id"] [stack="github.com/pingcap/tidb/parser/terror.MustNil\n\t/      Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/parser/terror/terror.go:298\nmain.createStoreAndDomain\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/tidb-        server/main.go:299\nmain.main\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/tidb-server/main.go:204\nruntime.main\n\t/opt/homebrew/Cellar/go/1.18.2/libexec/src/         runtime/proc.go:250"] [stack="github.com/pingcap/tidb/parser/terror.MustNil\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/parser/terror/terror.go:298\nmain.             createStoreAndDomain\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/tidb-server/main.go:299\nmain.main\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/        tidb-server/main.go:204\nruntime.main\n\t/opt/homebrew/Cellar/go/1.18.2/libexec/src/runtime/proc.go:250"]

I tried to modify server/versioninfo/MustParseVersion to directly return semver.New(featuresDict[Version5_0]). However, the tidb still can not be connected. And the logs are as follows

// pd log

   1 [2022/07/17 20:26:40.544 -04:00] [WARN] [server.go:298] ["exceeded recommended request limit"] [max-request-bytes=157286400] [max-request-            size="157 MB"] [recommended-request-bytes=10485760] [recommended-request-size="10 MB"]
   2 [2022/07/17 20:26:40.738 -04:00] [WARN] [store.go:1317] ["simple token is not cryptographically signed"]
   3 [2022/07/17 20:26:40.819 -04:00] [WARN] [metrics.go:193] ["failed to get file descriptor usage"] [error="cannot get FDUsage on darwin"]
   4 [2022/07/17 20:26:45.041 -04:00] [WARN] [dynamic_config_manager.go:164] ["Dynamic config does not exist in etcd"]
   5 [2022/07/17 20:27:03.442 -04:00] [WARN] [grpclog.go:60] ["transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:4479-         >127.0.0.1:58610: use of closed network connection"]
   6 [2022/07/17 20:27:03.443 -04:00] [WARN] [grpclog.go:60] ["transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:4479-         >127.0.0.1:58609: use of closed network connection"]
   7 [2022/07/17 20:27:03.443 -04:00] [WARN] [grpclog.go:60] ["transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:4479-         >127.0.0.1:58625: use of closed network connection"]
   8 [2022/07/17 20:27:03.443 -04:00] [WARN] [grpclog.go:60] ["transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:4479-         >127.0.0.1:58626: use of closed network connection"]

// tidb log

...
[2022/07/17 20:27:23.480 -04:00] [ERROR] [kv.go:243] ["fail to load safepoint from pd"] [error="context deadline exceeded"]
  26 [2022/07/17 20:27:23.481 -04:00] [ERROR] [client.go:907] ["[pd] update connection contexts failed"] [dc=global] [error="rpc error: code =             Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\""]
  27 [2022/07/17 20:27:23.951 -04:00] [ERROR] [base_client.go:144] ["[pd] failed updateMember"] [error="[PD:client:ErrClientGetLeader]get leader from      [http://127.0.0.1:4479] error"]
  28 [2022/07/17 20:27:26.819 -04:00] [ERROR] [base_client.go:144] ["[pd] failed updateMember"] [error="[PD:client:ErrClientGetLeader]get leader from      [http://127.0.0.1:4479] error"]
  29 [2022/07/17 20:27:29.481 -04:00] [ERROR] [kv.go:243] ["fail to load safepoint from pd"] [error="context deadline exceeded"]
  30 [2022/07/17 20:27:29.482 -04:00] [ERROR] [client.go:907] ["[pd] update connection contexts failed"] [dc=global] [error="rpc error: code =             Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\""]
  31 [2022/07/17 20:27:29.482 -04:00] [ERROR] [client.go:792] ["[pd] create tso stream error"] [dc-location=global] [error="[PD:client:                    ErrClientCreateTSOStream]create TSO stream failed, retry timeout"]
  32 [2022/07/17 20:27:29.482 -04:00] [ERROR] [pd.go:236] ["updateTS error"] [txnScope=global] [error="[PD:client:ErrClientCreateTSOStream]create TSO      stream failed, retry timeout"]
  33 [2022/07/17 20:27:29.482 -04:00] [ERROR] [base_client.go:144] ["[pd] failed updateMember"] [error="[PD:client:ErrClientGetLeader]get leader from      [http://127.0.0.1:4479] error"]
  34 [2022/07/17 20:27:29.746 -04:00] [ERROR] [base_client.go:144] ["[pd] failed updateMember"] [error="[PD:client:ErrClientGetLeader]get leader from      [http://127.0.0.1:4479] error"]
  35 [2022/07/17 20:27:32.737 -04:00] [ERROR] [base_client.go:144] ["[pd] failed updateMember"] [error="[PD:client:ErrClientGetLeader]get leader from      [http://127.0.0.1:4479] error"]
  36 [2022/07/17 20:27:32.737 -04:00] [WARN] [backoff.go:158] ["pdRPC backoffer.maxSleep 40000ms is exceeded, errors:\nloadRegion from PD failed,          key: \"6D426F6F7473747261FF704B657900000000FB0000000000000073\", err: rpc error: code = Unavailable desc = connection error: desc = \"transport:      Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\" at 2022-07-17T20:27:23.951276-04:00\nloadRegion from PD failed, key:       \"6D426F6F7473747261FF704B657900000000FB0000000000000073\", err: rpc error: code = Unavailable desc = connection error: desc = \"transport:           Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\" at 2022-07-17T20:27:26.819438-04:00\nloadRegion from PD failed, key:       \"6D426F6F7473747261FF704B657900000000FB0000000000000073\", err: rpc error: code = Unavailable desc = connection error: desc = \"transport:           Error while dialing dial tcp 127.0.0.1:4479: connect: connection refused\" at 2022-07-17T20:27:29.746725-04:00\nlongest sleep type: pdRPC, time:      29039ms"]
  37 [2022/07/17 20:27:32.737 -04:00] [FATAL] [session.go:2951] ["check bootstrapped failed"] [error="[tikv:9001]PD server timeout"] [stack="github.       com/pingcap/tidb/session.getStoreBootstrapVersion\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/session/session.go:2951\ngithub.com/     pingcap/tidb/session.BootstrapSession\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/session/session.go:2719\nmain.                       createStoreAndDomain\n\t/Users/lijiarui/Works/pingcap/internship/tikv-test/tidb/tidb-server/main.go:301\nmain.main\n\t/Users/lijiarui/Works/          pingcap/internship/tikv-test/tidb/tidb-server/main.go:204\nruntime.main\n\t/opt/homebrew/Cellar/go/1.18.2/libexec/src/runtime/proc.go:250"]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions