极小概率出现Socket.cpp:536 onAccept | Accept socket failed: too many open files的情况，仅出现一次

[zhengguimin]

[我的程序的TCP、UDP部分的框架完全使用这个项目的，现在遇到一个内存泄漏的问题(消耗50多个GB)，不确定是否框架相关，但是我一直模拟断开连接的动作也不可复现，不知道怎么处罚这个错误，请帮忙看看框架上是否可以增加日志分析的呢？

[zhengguimin]

[zhengguimin]

[zhengguimin]

补充：服务器是运行很久之后才出现的

[zhengguimin]

补充信息：泄漏的时候，看着有很多session无法正常释放，体现在系统是很多匿名内存
[root@e0b2b8a5-3f66-5615-80b6-25e6e36b2886 ~]# pmap -x 27509
27509: /usr/local/bin/vhostproxy/VHostProxy
Address Kbytes RSS Dirty Mode Mapping
00000000003ff000 4 0 0 rw--- VHostProxy (deleted)
0000000000400000 1808 752 0 r-x-- VHostProxy (deleted)
00000000007c3000 32 24 4 r---- VHostProxy (deleted)
00000000007cb000 4 4 4 rw--- VHostProxy (deleted)
00000000007cc000 16 16 16 rw--- [ anon ]
0000000001b7e000 1340 1168 1168 rw--- [ anon ]
00007f4cc8000000 102436 102436 102436 rw--- [ anon ]
00007f4cce409000 28636 0 0 ----- [ anon ]
00007f4cd0000000 131072 131072 131072 rw--- [ anon ]
00007f4cd8000000 131072 131072 131072 rw--- [ anon ]
00007f4ce0000000 131072 131072 131072 rw--- [ anon ]
00007f4ce8000000 131072 131072 131072 rw--- [ anon ]
00007f4cf0000000 131072 131072 131072 rw--- [ anon ]
00007f4cf8000000 131072 131072 131072 rw--- [ anon ]
00007f4d00000000 131072 131072 131072 rw--- [ anon ]
00007f4d08000000 131072 131072 131072 rw--- [ anon ]
00007f4d10000000 131072 131072 131072 rw--- [ anon ]
00007f4d18000000 131072 131072 131072 rw--- [ anon ]
00007f4d20000000 131072 131072 131072 rw--- [ anon ]
00007f4d28000000 131072 131072 131072 rw--- [ anon ]
00007f4d30000000 131072 131072 131072 rw--- [ anon ]
00007f4d38000000 131072 131072 131072 rw--- [ anon ]
00007f4d44000000 65536 65536 65536 rw--- [ anon ]
00007f4d4c000000 1720 1720 1720 rw--- [ anon ]
00007f4d4c1ae000 63816 0 0 ----- [ anon ]
00007f4d50000000 3184 868 868 rw--- [ anon ]
00007f4d5031c000 62352 0 0 ----- [ anon ]
00007f4d58000000 3472 3468 3468 rw--- [ anon ]
00007f4d58364000 62064 0 0 ----- [ anon ]
00007f4d68000000 2172 2172 2172 rw--- [ anon ]
00007f4d6821f000 63364 0 0 ----- [ anon ]
00007f4d6c000000 3052 3052 3052 rw--- [ anon ]
00007f4d6c2fb000 62484 0 0 ----- [ anon ]
00007f4d70000000 4760 4760 4760 rw--- [ anon ]
00007f4d704a6000 60776 0 0 ----- [ anon ]
00007f4d7c000000 13940 11028 11028 rw--- [ anon ]
00007f4d7cd9d000 51596 0 0 ----- [ anon ]
00007f4d84000000 4984 2292 2292 rw--- [ anon ]
00007f4d844de000 60552 0 0 ----- [ anon ]
00007f4d8c000000 6268 6268 6268 rw--- [ anon ]
00007f4d8c61f000 59268 0 0 ----- [ anon ]
00007f4d90000000 65536 65536 65536 rw--- [ anon ]
00007f4d94000000 9256 9256 9256 rw--- [ anon ]
00007f4d9490a000 56280 0 0 ----- [ anon ]
00007f4d9c000000 8868 8868 8868 rw--- [ anon ]
00007f4d9c8a9000 56668 0 0 ----- [ anon ]
00007f4da0000000 4988 4988 4988 rw--- [ anon ]
00007f4da04df000 60548 0 0 ----- [ anon ]
00007f4da8000000 12212 12212 12212 rw--- [ anon ]
00007f4da8bed000 53324 0 0 ----- [ anon ]
00007f4dac000000 8244 8244 8244 rw--- [ anon ]
00007f4dac80d000 57292 0 0 ----- [ anon ]
00007f4db0000000 15280 15280 15280 rw--- [ anon ]
00007f4db0eec000 50256 0 0 ----- [ anon ]
00007f4dbc000000 14004 14004 14004 rw--- [ anon ]
00007f4dbcdad000 51532 0 0 ----- [ anon ]
00007f4dc0000000 21968 21968 21968 rw--- [ anon ]
00007f4dc1574000 43568 0 0 ----- [ anon ]
00007f4dc8000000 21124 21124 21124 rw--- [ anon ]
00007f4dc94a1000 44412 0 0 ----- [ anon ]
00007f4dd0000000 25312 25312 25312 rw--- [ anon ]
00007f4dd18b8000 40224 0 0 ----- [ anon ]
00007f4ddc000000 27292 27292 27292 rw--- [ anon ]
00007f4dddaa7000 38244 0 0 ----- [ anon ]
00007f4de0000000 24100 22716 22716 rw--- [ anon ]
00007f4de1789000 41436 0 0 ----- [ anon ]
00007f4dec000000 27992 27992 27992 rw--- [ anon ]
00007f4dedb56000 37544 0 0 ----- [ anon ]
00007f4df0000000 28856 25448 25448 rw--- [ anon ]
00007f4df1c2e000 36680 0 0 ----- [ anon ]
00007f4df4000000 32376 31712 31712 rw--- [ anon ]
00007f4df5f9e000 33160 0 0 ----- [ anon ]
00007f4e00000000 29996 29996 29996 rw--- [ anon ]
00007f4e01d4b000 35540 0 0 ----- [ anon ]
00007f4e04000000 31756 31756 31756 rw--- [ anon ]
00007f4e05f03000 33780 0 0 ----- [ anon ]
00007f4e08000000 28528 28528 28528 rw--- [ anon ]
00007f4e09bdc000 37008 0 0 ----- [ anon ]
00007f4e0c000000 33924 33924 33924 rw--- [ anon ]
00007f4e0e121000 31612 0 0 ----- [ anon ]
00007f4e10000000 36244 36244 36244 rw--- [ anon ]
00007f4e12365000 29292 0 0 ----- [ anon ]
00007f4e14000000 34452 34452 34452 rw--- [ anon ]
00007f4e161a5000 31084 0 0 ----- [ anon ]
00007f4e18000000 31768 31768 31768 rw--- [ anon ]
00007f4e19f06000 33768 0 0 ----- [ anon ]

[zhengguimin]

这边找到了一个必现内存泄漏的步骤：

1. 测试程序：tests/test_vsock46000test.cpp，这边启动10000个TCP客户端连接请求

#include <csignal>
#include <iostream>
#include "Util/logger.h"
#include "Network/TcpClient.h"
#include "common/common.h"
#include "cjson/rc_json.h"
#include "Network/vio_sockets.h"
using namespace std;
using namespace toolkit;

class Vsock46000Client : public TcpClient {
public:
    using Ptr = std::shared_ptr<Vsock46000Client>;
    Vsock46000Client(uint64_t _package_cid) :TcpClient() , package_cid(_package_cid)
    {
        TraceL;
    }
    ~Vsock46000Client() {
        DebugL;
    }
protected:
    virtual void onConnect(const SockException& ex) override {
        //▒▒ӽ▒▒▒¼▒
        InfoL << (ex ? ex.what() : "success");
#if 0
        if (!ex) {
            auto sendbuf = BufferRaw::create();
            if (sendbuf) {
                dataSend_AGENT_CID(sendbuf, package_cid);
                DebugL << "send link package_cid :"<< package_cid;
                DebugL << "send size = " << this->send(sendbuf);
            }
        }
#endif
        //vsocke 45001 -> send("succuss");
    }
    virtual void onRecv(const Buffer::Ptr& buf) override {
        //▒▒▒▒▒▒▒▒¼▒
         /*▒▒▒▒45001 proxy▒▒▒͹▒▒▒▒▒▒▒*/
        TraceL << "recv size : " << buf->size() << std::string(buf->data()) << " from port:" << get_local_port();
    }
    virtual void onFlush() override {
        //▒▒▒▒▒▒▒▒󣬻▒▒▒▒▒▒▒¼▒
        DebugL;
    }
    virtual void onError(const SockException& ex) override {
        //▒Ͽ▒▒▒▒▒¼▒▒▒һ▒▒▒▒EOF
        WarnL << ex.what();
        //vsocke 45001 -> send("failed");
    }
    virtual void onManager() override {
        //▒▒ʱ▒▒▒▒▒▒ݵ▒▒▒▒▒▒▒
        TraceL;
    }
private:
    int _nTick = 0;
    uint64_t package_cid = -1;
    uint64_t connectId = 0;
    uint32_t streamdId = 0;
};
std::unordered_map<int,Vsock46000Client::Ptr>  testMap;

int main() {
    // ▒▒▒▒▒▒־ϵͳ
    int  mainSock = -1;

    Logger::Instance().add(std::make_shared<ConsoleChannel>());
    Logger::Instance().add(std::make_shared<FileChannel>());
    Logger::Instance().setWriter(std::make_shared<AsyncLogWriter>());
    Logger::Instance().setLevel(LogLevel::LTrace);

    for (int i = 0; i < 10000; i++) {
        Vsock46000Client::Ptr client(new Vsock46000Client(i+1));//▒▒▒▒ʹ▒▒▒▒▒▒ָ▒▒
        //client->startConnect(VSOCK_HOST_CID, VSOCK_46000_PORT);//▒▒ӷ▒▒▒▒▒
        client->startConnect("127.0.0.1", VSOCK_46000_PORT);
        testMap[i] = client;
    }
    //▒˳▒▒▒▒▒¼▒▒▒▒▒
    static semaphore sem;
    signal(SIGINT, [](int) { sem.post(); });// ▒▒▒▒▒˳▒▒ź▒
    sem.wait();
    return 0;
}

2. 服务端核心部分就是如下，只列取部分

class VSockManagerSession : public Session
{
public:
    using Ptr = std::shared_ptr<VSockManagerSession>;
public:
    VSockManagerSession(const Socket::Ptr& sock);
    ~VSockManagerSession();
    virtual void onRecv(const Buffer::Ptr& buf) override;
    virtual void onError(const SockException& err) override;
    virtual void onManager() override;

private:

    Ticker _ticker;

    PacketHeader header;

    RutpIdentifier searchRI;

    std::atomic<int> heartBeatCount;

    void cleanUpRutpVsock();
};
TcpServer::Ptr vsockRutpMangerServer;
// 这边只做建立连接的动作
    vsockRutpMangerServer.reset(new TcpServer());
    vsockRutpMangerServer->start<VSockManagerSession>(VSOCK_46000_PORT, "127.0.0.1");

3. 然后先运行服务端
4. 运行一个拷机脚本，就是频繁的启动客户端和杀死客户端
   [root@f40db308-fc69-51b6-94f2-2cb197397f74 ~]# cat test.sh
   #!/bin/bash

while :
do
/usr/local/bin/vhostproxy/test_vsock46000test &
sleep 10
pkill test_vsock46000test
sleep 10
done
5. 观察服务端的进程，很容易就到1gb以上

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
42200 root 20 0 10.0g 8.5g 5020 D 8.3 8.7 0:14.04 async log
42212 root 20 0 10.0g 8.5g 5020 D 5.3 8.7 0:10.02 event poller 9
42254 root 20 0 10.0g 8.5g 5020 D 5.3 8.7 0:11.37 event poller 19
42256 root 20 0 10.0g 8.5g 5020 D 5.3 8.7 0:11.82 event poller 21
42257 root 20 0 10.0g 8.5g 5020 D 5.3 8.7 0:11.60 event poller 22
42262 root 20 0 10.0g 8.5g 5020 D 5.3 8.7 0:11.37 event poller 27
42206 root 20 0 10.0g 8.5g 5020 D 5.0 8.7 0:09.99 event poller 4
42225 root 20 0 10.0g 8.5g 5020 R 5.0 8.7 0:11.60 event poller 18
42264 root 20 0 10.0g 8.5g 5020 D 5.0 8.7 0:11.84 event poller 29
42270 root 20 0 10.0g 8.5g 5020 D 5.0 8.7 0:12.05 event poller 33
42274 root 20 0 10.0g 8.5g 5020 D 5.0 8.7 0:11.71 event poller 36
42276 root 20 0 10.0g 8.5g 5020 D 5.0 8.7 0:12.08 event poller 37
42286 root 20 0 10.0g 8.5g 5020 D 5.0 8.7 0:11.90 event poller 43
42290 root 20 0 10.0g 8.5g 5020 D 5.0 8.7 0:12.15 event poller 46
42255 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:11.92 event poller 20
42258 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:11.77 event poller 23
42259 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:11.32 event poller 24
42260 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:12.08 event poller 25
42261 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:11.62 event poller 26
42263 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:12.26 event poller 28
42266 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:12.05 event poller 31
42281 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:11.51 event poller 40
42284 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:11.65 event poller 41
42288 root 20 0 10.0g 8.5g 5020 D 4.6 8.7 0:11.76 event poller 44
42208 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:09.56 event poller 5
42210 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:09.65 event poller 7
42211 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:08.99 event poller 8
42213 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:09.37 event poller 10
42222 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.57 event poller 16
42223 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.12 event poller 17
42265 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.28 event poller 30
42268 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.61 event poller 32
42273 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.91 event poller 35
42277 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.89 event poller 38
42285 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.72 event poller 42
42289 root 20 0 10.0g 8.5g 5020 D 4.3 8.7 0:11.78 event poller 45
42202 root 20 0 10.0g 8.5g 5020 D 4.0 8.7 0:09.84 event poller 0
42203 root 20 0 10.0g 8.5g 5020 D 4.0 8.7 0:09.21 event poller 1
42205 root 20 0 10.0g 8.5g 5020 D 4.0 8.7 0:09.43 event poller 3
42214 root 20 0 10.0g 8.5g 5020 R 4.0 8.7 0:09.31 event poller 11
42272 root 20 0 10.0g 8.5g 5020 D 4.0 8.7 0:12.00 event poller 34
42291 root 20 0 10.0g 8.5g 5020 D 4.0 8.7 0:11.44 event poller 47
42204 root 20 0 10.0g 8.5g 5020 D 3.6 8.7 0:09.97 event poller 2
42216 root 20 0 10.0g 8.5g 5020 D 3.6 8.7 0:08.76 event poller 12
42219 root 20 0 10.0g 8.5g 5020 D 3.6 8.7 0:05.21 event poller 13
42280 root 20 0 10.0g 8.5g 5020 D 3.6 8.7 0:11.35 event poller 39
42209 root 20 0 10.0g 8.5g 5020 S 3.0 8.7 0:08.53 event poller 6
42221 root 20 0 10.0g 8.5g 5020 D 3.0 8.7 0:05.43 event poller 15
42220 root 20 0 10.0g 8.5g 5020 D 2.3 8.7 0:05.31 event poller 14
42201 root 20 0 10.0g 8.5g 5020 R 1.0 8.7 0:01.26 stamp thread
42199 root 20 0 10.0g 8.5g 5020 S 0.0 8.7 0:00.00 VHostProxy

[xia-chu]

您使用的ZLToolkit什么版本？修改过吗

[zhengguimin]

查了一下，应该是很新的，今天cherry-pick master上较新的一些提交，也是必现。我这边发现应该是TCPSession本身没有自动释放有关，咱们ZLToolkit有自动释放TCPSession的机制吗？

[xia-chu]

TCPSession你如果有其他地方强引用了 当然就没法释放啊

[zhengguimin]

服务端是启动以下代码，而且只启动一次，并监听46000端口。
vsockRutpMangerServer.reset(new TcpServer());
vsockRutpMangerServer->start(VSOCK_46000_PORT, "127.0.0.1");

VSockManagerSession是继承于Session类，我们的业务不会主动断开连接，那应该服务端就没法释放，我现在没看到Session类中有主动释放的接口

[zhengguimin]

因为你看我发的例子，仅是连接的，没有收发消息，那应该是框架要如何释放连接的这部分底层资源？

[xia-chu]

我们的业务不会主动断开连接，那应该服务端就没法释放，我现在没看到Session类中有主动释放的接口

你应该在onManager中做超时管理啊

[zhengguimin]

可是在客户端关闭后，我的VSockManagerSession 已经退出了，onManager 也不会触发了，好像就不能做超时管理了吧？
[root@f40db308-fc69-51b6-94f2-2cb197397f74 ~]# /usr/local/bin/vhostproxy/start.sh
2026-03-03 05:59:34.562 D [VHostProxy] [40246-stamp thread] util.cpp:366 operator() | Stamp thread started
2026-03-03 05:59:34.566 I [VHostProxy] [40246-VHostProxy] EventPoller.cpp:500 EventPollerPool | EventPoller created size: 48
2026-03-03 05:59:34.567 W [VHostProxy] [40246-VHostProxy] Socket.cpp:857 cloneSocket | cloneSocket +++++++++++
2026-03-03 05:59:34.567 W [VHostProxy] [40246-VHostProxy] Socket.cpp:857 cloneSocket | cloneSocket +++++++++++
Last message repeated 46 times
2026-03-03 05:59:34.568 I [VHostProxy] [40246-VHostProxy] TcpServer.cpp:218 start_l | TCP server listening on [127.0.0.1]: 46000
2026-03-03 05:59:42.171 D [VHostProxy] [40246-event poller 1] VSockManager.cpp:21 VSockManagerSession | VSockManagerSession
2026-03-03 05:59:44.567 D [VHostProxy] [40246-event poller 1] VSockManager.cpp:122 onManager | VSockManagerSession::onManager fd: 149, alive: 1
2026-03-03 05:59:54.576 D [VHostProxy] [40246-event poller 1] VSockManager.cpp:122 onManager | VSockManagerSession::onManager fd: 149, alive: 1
2026-03-03 05:59:56.413 D [VHostProxy] [40246-event poller 1] VSockManager.cpp:100 onError | VSockManagerSession closed, fd: 149, error: end of file, code: 1
2026-03-03 05:59:56.413 D [VHostProxy] [40246-event poller 1] VSockManager.cpp:26 ~VSockManagerSession | ~VSockManagerSession

[xia-chu]

我的意思是 如果你拔网线了 就不会自动eof断开 那么你就要onManager判断是否已经超时并调用shutdown主动关闭session