0%

ComfyUI-based Decentralized Content Generation Platform

1. ComfyUI

https://github.com/comfyanonymous/ComfyUI

在介绍我们去中心化的内容生成平台之前,我们先介绍一下ComfyUI是什么,以及他的理念。

ComfyUI—The most powerful and modular diffusion model GUI and backend.

Before introducing our decentralized content generation platform, let’s explain what ComfyUI is and its concept firstly.

ComfyUI—The most powerful and modular diffusion model GUI and backend.

image.png

从它的介绍可知,它是一个让你在stable diffusion等大量生成模型之间设计一条满足自己工作流程需要的框架。每一个模型或者数据操作被设计成了一个个node被允许添加到你们的工作流中。在这里你可以结合各种模型之间的优势,在本地构建自己特色的内容生成工作流。包括但不止text2img, img2img, impating, lora 等工作流。

From its description, we can see that it is a framework that allows you to design a workflow that meets your needs among a large number of generative models such as stable diffusion. Each model or data operation is designed as a node that can be added to your workflow. Here you can combine the advantages of various models to build your own unique content generation workflow locally. This includes but is not limited to, text2img, img2img, inpainting, lora, and other workflows.

2. ComfyUI痛点 ComfyUI Pain Points

但是,ComfyUi也存在一个巨大的痛点,那就是如果你的工作流中运行了大量的模型,那么你将需要一台超高性能的电脑来同时运行这些模型。现实是我们个人可能运行工作流中的一个或一些模型。

However, ComfyUI also has a significant pain point. If your workflow runs a large number of models, you will need a high-performance computer to run these models on one local computer. The reality is that we as individuals may only be able to run one or a few models in the workflow in our PC.

image.png

3. 去中性化的ComfyUI Decentralized ComfyUI

得益于ComfyUI的设计,我们其实可以把工作流中的每一个node看作一个独立的个体使用。那么我们为什么要在不同的电脑中创建同样的node呢?这完全是一中算力的浪费。试想,我的电脑只够我运行A模型node,而Smith的电脑够运行B模型node,Jone则是C模型node。如果我的工作流程需要A,B,C这四个node,那是不是我可以借用Smith和Jone的算力便可运行?同样的Smith和Jone也可以使用我的node运行他们想要的工作流。唯一需要的就是我们node作为API服务暴露给各位。

Thanks to ComfyUI’s design, we can actually treat each node in the workflow as an independent entity. So why should we create the same nodes on different computers? This is a complete waste of computing power. Imagine if my computer is only capable of running model node A, while Smith’s computer can run model node B, and Jones can run model node C. If my workflow requires nodes A, B, and C, could I borrow the computing power from Smith and Jones to run it? Correspondingly, Smith and Jones could also use my node to run the workflows they want. The only thing needed for us is to expose our nodes as API services to everyone.

DComfyU.drawio.png

4. 如何构建去中性化的ComfyUI How to Build a Decentralized ComfyUI

在我的计划中,我们应该是高度依赖ComfyUI或者它的node思想来构建我们的去中性化平台。主要的设计有下面几点:

In my plan, we should heavily rely on ComfyUI or its node concept to build our decentralized platform. The main designs include the following points:

1. ComfyUI API service node 服务节点 ComfyUI API Service Node

我们可以基于ComfyUI的特性,直接构建API service node 节点,尝试将其他模型的节点node自动打包成一个个的API service暴露给其他使用者。

Based on ComfyUI’s features, we can directly build API service nodes, attempting to automatically package the other model’s nodes into individual API services exposed to other users.

2. Node management center 节点管理中心 Node Management Center

虽然我们可以自己构建很多ComfyUI API service node节点,但是大部分人是不具备公有IP将自己的服务暴露在。我们应该构建一个节点管理中心,管理服务节点的同时,转发各个私有IP服务节点,暴露给其他用户。而使用者也可以通过管理中心使用自己想要的节点服务。

Although we can build many ComfyUI API service nodes ourselves, most people do not have a public IP to expose their services. We should build a node management center that manages service nodes while forwarding various private IP service nodes, exposing them to other users. Users can also use the node services they want through the management center.

3. Security (use tokens, data transmission crypto, anonymous, and so on) 安全(tokens, 数据传输加密,匿名化等等) Security (use tokens, data transmission crypto, anonymous, and so on)

节点管理中心构建成功的化,接下来我们就需要在服务节点,管理中心,使用者之间构建安全可靠的通信服务。token认证,传输数据加,匿名化等都需要我们提供支持。

If the node management center is successfully built, we then need to build secure and reliable communication services between service nodes, management centers, and users. We need to provide support for token authentication, data transmission encryption, anonymization, and more.

4. Payment Strategy(cyber currency? Onlie payment? Credit cart?) 支付策略(加密货币, 在线支付, 信用卡) Payment Strategy (cryptocurrency? Online payment? Credit card?)

为了更大化的推广我们的去中心化节点,利益当然是最大的推手。我们需要节点的使用者支付一定的费用给节点的提供者,同时节点管理中心也需要一定的资金支持服务器和电信服务的费用。这样子才可以促进整个社区的正向发展。

To maximize the promotion of our decentralized nodes, profit is certainly the biggest driver. We need node users to pay a certain fee to node providers, and the node management center also needs some funds to support server and telecommunication service costs. By this way, we can promote the positive development of the entire community.

5. Everyone can make money, and everyone can use large computing power services 每个人都可以通过它挣钱,每个人都可以使用大计算量的服务

至此,每一个人都可以使用自己的电脑搭建一个节点来获得收益,而大家也可以任意的使用最大量的算力生成自己想要的内容。

Therefore, everyone can use their computer to set up a node to earn income, and everyone can use the maximum amount of computing power to generate the content they want.

5. 另外 Moreover

另外, 虽然我们的平台是基于ComfyUI的概念,但是,我认为通过合理的设计,我们不但可以把这个平台使用到内容生成工作流中,我们可以应用到任何的AI模型工作流算力共享中。我们力求构建一个全球AI算力共享平台。或许以后还可以使用这个平台进行模型的训练和数据的收集等AI模型的前置 。

In addition, although our platform is based on the concept of ComfyUI, I believe that through reasonable design, we can not only use this platform in content generation workflows, but we can also apply it to any AI model workflow computing power sharing. We strive to build a global AI computing power sharing platform. Perhaps in the future, we can also use this platform for model training and data collection, and other AI model prerequisites.

If you like my, Donate here.