Hololens TCP套接字-Python客户端到Hololens服务器

Question

经过几周的挫折，我终于能够将字符串从Python客户端发送到Hololens服务器。代码如下，运行良好。然而，我想知道有没有熟悉套接字的人可以帮助我修改这段代码，将openCV网络摄像头帧(所以基本上只是发送一个图像(从Python发送到Hololens。我一直在尝试，但C#脚本中似乎没有接收到图像数据。

非常感谢。

Hololens服务器代码：

using System;
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.UI;
#if !UNITY_EDITOR
using Windows.Networking;
using Windows.Networking.Sockets;
using Windows.Storage.Streams;
#endif
//Able to act as a reciever 
public class UniversalSampleTutorial : MonoBehaviour
{
public String _input = "Waiting";
#if !UNITY_EDITOR
StreamSocket socket;
StreamSocketListener listener;
String port;
String message;
#endif
// Use this for initialization
void Start()
{
#if !UNITY_EDITOR
listener = new StreamSocketListener();
port = "9090";
listener.ConnectionReceived += Listener_ConnectionReceived;
listener.Control.KeepAlive = false;
Listener_Start();
#endif
}
#if !UNITY_EDITOR
private async void Listener_Start()
{
Debug.Log("Listener started");
try
{
await listener.BindServiceNameAsync(port);
}
catch (Exception e)
{
Debug.Log("Error: " + e.Message);
}
Debug.Log("Listening");
}
private async void Listener_ConnectionReceived(StreamSocketListener sender, StreamSocketListenerConnectionReceivedEventArgs args)
{
Debug.Log("Connection received");
try
{
while (true) {
using (var dw = new DataWriter(args.Socket.OutputStream))
{
dw.WriteString("Hello There");
await dw.StoreAsync();
dw.DetachStream();
}  
using (var dr = new DataReader(args.Socket.InputStream))
{
dr.InputStreamOptions = InputStreamOptions.Partial;
await dr.LoadAsync(12);
var input = dr.ReadString(12);
Debug.Log("received: " + input);
_input = input;
}
}
}
catch (Exception e)
{
Debug.Log("disconnected!!!!!!!! " + e);
}
}
#endif
void Update()
{
this.GetComponent<TextMesh>().text = _input;
}
}

Python客户端(需要从这里发送图像而不是字符串(

import asyncio
#THIS CODE WORKS SENDING STRING MESSAGE TO HOLOLENS
async def tcp_echo_client(message, loop):
reader, writer = await asyncio.open_connection('192.168.1.110', 9090, loop=loop)
print('Send: %r' % message)
writer.write(message.encode())
data = await reader.read(100)
print('Received: %r' % data.decode())
print('Close the socket')
writer.close()

message = 'hello there frend'
loop = asyncio.get_event_loop()
loop.run_until_complete(tcp_echo_client(message, loop))
loop.close()

编辑：这是我一直在处理的图像代码。它还不起作用，我不确定我是否正确接收到字节数组：https://gist.github.com/jryebread/3961e890375fcc8a64c8ac3d279ec9fa

Answer 1

我已经想好了如何发送图像。我最终从python客户端发送了日期，作为一个字符串base64编码并解码了hololens服务器脚本上的字符串。

https://gist.github.com/jryebread/2bdf148313f40781f1f36d38ada85d47