使用 jq 重建 JSON

Question

我有一个这样的JSON(sample.json(：

{
"sheet1": [
{
"hostname": "sv001",
"role": "web",
"ip1": "172.17.0.3"
},
{
"hostname": "sv002",
"role": "web",
"ip1": "172.17.0.4"
},
{
"hostname": "sv003",
"role": "db",
"ip1": "172.17.0.5",
"ip2": "172.18.0.5"
}
],
"sheet2": [
{
"hostname": "sv004",
"role": "web",
"ip1": "172.17.0.6"
},
{
"hostname": "sv005",
"role": "db",
"ip1": "172.17.0.7"
},
{
"hostname": "vsv006",
"role": "db",
"ip1": "172.17.0.8"
}
],
"sheet3": []
}

我想提取这样的数据：

表1

jq '(something command(' sample.json

{
"web": {
"hosts": [
"172.17.0.3",
"172.17.0.4"
]
},
"db": {
"hosts": [
"172.17.0.5"
]
}
}

是否可以使用 jq 映射进行重建？ (我将在 ansible 库存中重复使用结果。

Answer 1

这是一个简短、直接且高效的解决方案 - 部分高效，因为它避免了以下通用帮助程序函数的group_by：

def add_by(f;g): reduce .[] as $x ({}; .[$x|f] += [$x|g]);

.sheet1
| add_by(.role; .ip1) 
| map_values( {hosts: .} )

输出

这将生成所需的输出：

{
"web": {
"hosts": [
"172.17.0.3",
"172.17.0.4"
]
},
"db": {
"hosts": [
"172.17.0.5"
]
}
}

Answer 2

如果目标是按每个工作表中的角色重新分组 ip，您可以这样做：

map_values(
reduce group_by(.role)[] as $g ({};
.[$g[0].role].hosts = [$g[] | del(.hostname, .role)[]]
)
)

这会产生这样的东西：

{
"sheet1": {
"db": {
"hosts": [
"172.17.0.5",
"172.18.0.5"
]
},
"web": {
"hosts": [
"172.17.0.3",
"172.17.0.4"
]
}
},
"sheet2": {
"db": {
"hosts": [
"172.17.0.7",
"172.17.0.8"
]
},
"web": {
"hosts": [
"172.17.0.6"
]
}
},
"sheet3": {}
}

https://jqplay.org/s/3VpRc5l4_m

如果你想把所有对象都平展到一个对象，只保留唯一的ip，你可以保持所有内容大致相同，你只需要在分组之前平展输入并删除map_values/1调用。

$ jq -n '
reduce ([inputs[][]] | group_by(.role)[]) as $g ({};
.[$g[0].role].hosts = ([$g[] | del(.hostname, .role)[]] | unique)
)
'

{
"db": {
"hosts": [
"172.17.0.5",
"172.17.0.7",
"172.17.0.8",
"172.18.0.5"
]
},
"web": {
"hosts": [
"172.17.0.3",
"172.17.0.4",
"172.17.0.6"
]
}
}

https://jqplay.org/s/ZGj1wC8hU3