并发的大型删除操作挂起在NodeJS

Question

我在Centos 7.2服务器上运行的NodeJS应用程序中有一个工作区清理功能，它需要目录路径列表并删除它们。当函数接收到路径列表时，它使用Promise.all()以以下方式并发地执行这些删除:

/**
* Deletes directories.
*
* @param   {Array} directories Array of directories to be deleted.
*
* @returns {Object} Response object with the status code and data.
*/
const cleanup = async (directories) => {
if (!Array.isArray(directories)) {
return await responseStatementHandler(
400,
`Provide a list of directories as an array - [dir1, dir2].`,
null,
console.error
);
}
if (!directories.length > 0) {
return await responseStatementHandler(
400,
`Directory list cannot be empty.`,
null,
console.error
);
}
try {
const promisesList = await Promise.all(
directories.map((d) => deleteDirectory(d))
);
return await responseStatementHandler(
207,
await promisesList,
null,
console.log
);
} catch (err) {
return await responseStatementHandler(
500,
`Directory cleanup failed.`,
err,
console.error
);
}
};
/**
* Performs a force delete on a provided directory.
*
* @param   {String} directory  Path of the directory to be deleted.
*
* @returns {Object} Response object with the status code and data.
*/
const deleteDirectory = async (directory) => {
console.log(`Deleting directory: ${directory}`);
try {
if ((await fs.stat(directory)).isDirectory()) {
await fs.rm(directory, { recursive: true, force: true });
return await generateIndividualResponseObj(
directory,
200,
`Successfully deleted directory: ${directory}`,
null,
console.log
);
}
} catch (err) {
if (err.message.includes("no such file or directory")) {
return await generateIndividualResponseObj(
directory,
404,
`Could not find directory: ${directory}`,
null,
console.error
);
}
return await generateIndividualResponseObj(
directory,
500,
`Failed to delete directory: ${directory}`,
err,
console.error
);
}
};

这里的问题是目录很大;~1G大小。因此，当有多个这样的删除(>10和>10G)时，操作只是挂起。

我知道这一点的原因是因为只要我手动删除目录，应用程序就可以正常运行，没有问题。

这是fs模块的限制还是逻辑编写方式的限制?在此场景中，删除操作的超时是否有帮助?如果是这样，我将如何实现这样一个超时与fs模块?

Answer 1

这里的问题不在于Node。服务器的硬盘很慢，执行大的删除需要很长时间。应用程序只是在等待删除过程完成，没有挂起。将服务器与更快的存储连接起来解决了这个问题。