Node JS中的响应缓冲区数据被截断

Question

我正试图弄清楚如何使用NodeJS中http和https内置模块的request函数(我知道第三方包装器，但我正在自己弄清楚(。我遇到了一个问题，来自Response的Buffer数据在最后被部分切断。使用cURL进行测试时不会出现此问题。

这是我一直在使用的代码：

const { request: httpRequest } = require("http");
const { request: httpsRequest } = require("https");
const parseURLData = (url, init) => {
const { hostname, protocol, port: somePort, pathname, search } = new URL(url);
const port = +somePort || (protocol === "https:" ? 443 : 80);
const options = { hostname, port, path: pathname + search, ...init };
return [protocol, options];
};
const makeRequest = (url, init = { method: "GET" }) => {
const [protocol, options] = argumentsToOptions(url, init);
const request = protocol === "http:" ? httpRequest : httpsRequest;
return new Promise((resolve, reject) =>
request(options, (res) => {
res.on("error", reject);
resolve(res);
})
.on("error", reject)
.end()
);
};
// not using `async/await` while testing
makeRequest("https://jsonplaceholder.typicode.com/users/1/")
.then((res) => 
new Promise((resolve) =>
res.on("data", (buffer) => {
resolve(buffer.toString("utf8")); // part of data is cut off
// resolve(JSON.parse(buffer.toString()));
})
)
)
.then(console.log)
.catch(console.error);

以下是预期输出(来自cURL(：

{
"id": 1,
"name": "Leanne Graham",
"username": "Bret",
"email": "[e-mail]",
"address": {
"street": "Kulas Light",
"suite": "Apt. 556",
"city": "Gwenborough",
"zipcode": "92998-3874",
"geo": {
"lat": "-37.3159",
"lng": "81.1496"
}
},
"phone": "1-770-736-8031 x56442",
"website": "hildegard.org",
"company": {
"name": "Romaguera-Crona",
"catchPhrase": "Multi-layered client-server neural-net",
"bs": "harness real-time e-markets"
}
}

这是实际输出，由于某种原因，每次运行代码时都会略有不同：

{
"id": 1,
"name": "Leanne Graham",
"username": "Bret",
"email": "[e-mail]",
"address": {
"street": "Kulas Light",
"suite": "Apt. 556",
"city": "Gwenborough",
"zipcode": "92998-3874",
"geo": {
"lat": "-37.3159",
"lng": "81.1496"
}
},
"p

这个问题的正确解决方案是什么？如何从请求中获取所有数据？

Answer 1

只有在end事件触发时才应处理缓冲区，否则可能会处理不完整的缓冲区。

makeRequest("https://jsonplaceholder.typicode.com/users/1/")
.then((res) => 
new Promise((resolve) => {
let totalBuffer = "";
res.on("data", (buffer) => {
totalBuffer += buffer.toString("utf8");    
});
res.on("end", () => resolve(totalBuffer));
})
)
.then(console.log)
.catch(console.error);

当文件超过1mb时，响应几乎总是被截断为几个片段，因此有必要使用end事件，该事件表示流已经处理了所有可用数据。

https://nodejs.org/api/http.html查找"；JSON获取示例"；