How hard would it be to deploy to iOS

[abaybektursun]

How hard would it be to get let's say Q4_0 to run on an iOS device?

[saharNooby]

I guess as hard as it is to build anything C/C++ on iOS. Can't help with it though, I'm completely unfamiliar with Apple ecosystem.

[guinmoon]

How hard would it be to get let's say Q4_0 to run on an iOS device?

You can checkout my project. It's based on this great repo. You can replace the 20B tokenizer in the resources with your own if needed.