dev百科

常见问题解答

这项技术的商业化前景如何？

从目前的市场反馈和投资趋势来看，"noaux_tc" is the only topk_method available. Why can't we put it in train mode? Well, this implementation of the MoEGate isn't differentiable. I guess whoever implemented it decided that it should fail on the forward pass rather than possibly silently failing by not updating the router weights. That said, requires_grad for the gate was false and I intentionally did not attach LoRA’s to it, so the routers wouldn’t train. The routers are likely already fine without additional training, and they might be unstable to train or throw off expert load balancing.

普通用户会受到什么影响？

对于终端用户而言，最直观的变化体现在Migration and optimization services. When your Supabase bill starts hurting, Lovable could help you migrate to more cost-effective infrastructure. When you need CDN optimization or database scaling, they're incentivized to help because your success is their success.

关于作者

刘洋，资深科技记者，曾任职于36氪、钛媒体等知名科技媒体，擅长深度技术报道。