Bounty to convert all Ryzom data to a useful format
Sunday, May 15, 2011 - 00:57
Evening all
As you know, Ryzom's assets are under CC-BY-SA. But they're also in 3ds max format, not usable in any open program or engine.
Since Max is scriptable, how about pledging together a bounty for an experienced max scripter, to convert all of the data to an open format? I would pledge 70$ to start it ;)
I would suggest MS3D, since that is usable in most free apps & engines, and can contain skeletons and animations, unlike OBJ.
What do you think? Also, any able scripters who'd like the job? The converted models should keep texturing, skeletons and animations.
I already installed 3dsmax under wine, problem is, the files are not even in a standard max format, they require a custom Rhyzome importer. I eventually got the importer working under wine, mostly. However most of the files I opened didn't import properly. I only got half the textures and the animations didn't come across.
I spoke to the Rhyzome devs on IRC, they were very helpful getting it all working, but ultimately they weren't particularly keen on the assets actually getting out. I get the feeling they like the idea of being *seen* to be open source, but they don't want to actually make it any easier for people to get their assets.
I eventually gave up on the whole process.
Since it seems that no-one has documented the .MAX file format before, I thought that I'd have a look at it. I'll let you all know if I get anything useful out of my research.
EDIT 1: Work-In-Progress MAX file format specification (PDF format): Download.
EDIT 2: Got rid of the View Online option because it breaks whenever a new version is uploaded (like just now).
http://www.transmogrifier.de/ryzomtoogre/
Has a few converted models, but progress stalled too a longer time ago.
Would be still great if someone was to convert all those animations to a Blender readable format. I would also add to the bounty a few bucks.
--
http://freegamedev.net
Seems like we finally have a serious contender:
https://bitbucket.org/ccxvii/ryzom-assets/overview
https://github.com/ccxvii/asstools/
Haven't got them to import in Blender yet, but it seems like this guy knows what he is doing (I hope).
Having the full set of characters and animations in a blender importable format would be huge!
Edit: and I just learned in the RyzomCore IRC that someone is also working on a direct blender NEL3d importer and exporter :D
Edit: got it to work... was just to stupid to download the .iqes from bitbucket! THIS is HUGE!
--
http://freegamedev.net
I have converted the 3ds max files to fbx. Then I converted those to obj. I have uploaded them onto github here.
https://github.com/NDxTreme/Open3D-Models
I have uploaded the textures here.
https://github.com/NDxTreme/Base-Ryzom
I figured the images would be the least chinging of the set, and can be shared for those that wish to use them with the original files, witch are also uploaded on my repository.
I have done no organization or cleanup at this time, that is my next step. Also, I looked into creating .blend files, but haven't the experience with blender to wade through the best way to batch that.
I would ignore any of the obj in directories titled anim, as they will most likely be duplicates of other meshes.
Hopefully this is useful to someone.
NDxTreme.com
well, the real issue was always the animations and not the meshes. But with the .iqm linked above this issue is also mostly fixed.
--
http://freegamedev.net
EDITED: Fixed spelling errors and gramatical mistakes.
Well, no, that was ONE of the issues. There were in fact many.
1) The original files had a custom built "Nel Material" applied to them, that would prevent transport rom 3ds Max, and indeed prevented use of these assets in anything later than 3ds Max 2012 as the plugins could not be compiled for later versions of Max without a major porting effort due to some fundamental Unicode changes in Max.
I have replaced all of the original Nel Materials with the Default Material in Max, which means that the Max files can be used with the latest versions of 3ds Max.
2) The iqe format does not have importers and exporters for many pipelines.
Fbx is supported in most 3d DCCs, including Blender, albeit that support is maturing quickly.
3) Iqe is not supported in Max, meaning that some data from the original files could be lost.
Using a format supported both by Max and Blender means the least possible loss of information between conversion, making these files more suitable to reimport into the Ryzom core once a Blender plugin is created.
4) The animations are in fact fully attached in the fbx files, after all, fbx started out as a way to transport animation from Motionbuilder to many different DCC applications.
Therefore, that requirement is met. It is true that Blender is still working on implementing all the features of FBX, but that support is only ging to get better. (As an example, Blender cannot currently read the ASCII version of FBX, even though you would think that would be easier.)
5) Fbx allows for importing into Mudbox, which was my original use case for these assets. I have linked to my efforts here mainly due to an effort of wanting to share my efforts.
However, some of the geometry in these files is non manifold, preventing their use in Mudbox or Zbrush without editing. These may cause issues in other game engines as well, as they are generally more taxing for the GPU to process.
6) I provided the . objs as a way to test the fbx imports to ensure that blender was importing the model correctly. Also, obj are ASCII files, which should be easier for Github to work with.
7) Fbx is the main format for Unity, and Unreal Engine, which are my main game engines of choice. Both support Substance materials, of which I am working to learn. So this is the most practical solution for my needs.
And, of course I am required to release the changes I have made, so this is my way of doing so.
NDxTreme.com
I stand corrected then, your original post sounded like it was just the .obj files. I had a look at the github pages now, and it is indeed all that is needed (and I agree, fbx is better than iqe).
Thanks for the great job, and I am sure this will come in handy for some people!
Any particular reason for wanting to have these meshes in Mudbox? Are you planning on creating some high quality normal-maps for them?
--
http://freegamedev.net
Sorry, I sometimes have teeth.
As for Mudbox, I am teaching myself all the different aspects of 3d to see what I like best, and I have a lot of ideas surrounding these assets, such as turning them into parts for makehuman, setup a uma system for unity, and just various other ideas.
I would also like an all quad topology to use the base design to showcase the assets, and allow for easy later use in animation projects I, or others might consider.
This is just a small list, but basically I am using these to learn the different approaches to piplines, and looking for pain points, of which there are many.
NDxTreme.com
can these not be uploaded to OGA ? or is that not allowed ? i realise they are HUGE but they are a good resource !
It's a lot of work to create previews for everything, plus the IQE format doesn't have that much support. The props could be converted to say obj, but losing the wind information in trees, etc.
I could be persuaded to script that for a few hundred tho ;)
NDxTreme has converted them to fbx/obj already i believe, you can grab them from the github pages
Open3D-Models Github - models
Base Ryzom Github - textures/fonts/gui/etc
The repos contain the source .max and converted .obj and .fbx files, i havent had much time to play but if i understand this correctly:
they should all work ?
as for the previews, could they not be released in packs, like per race building/model packs just to try and shrink the amount of work to be done for previews ?
Yes, if you want to create the packs, go ahead ;)
i see what you did there :P i doubt id ever get round to it, my list of things i need to do keeps getting longer :D
i still havent played with them much, only figuring out how theyre organised and previewing some of them in blender
EDIT: having a think about it, the Base-Ryzom repo wouldnt take much, only previews, which would be a hell of a lot easier than creating previews of the Open3D-Models repo
still not saying im doing it tho :P
@gobusto Read my series on the 3ds Max file format. It explains everything.
http://www.kaetemi.be/wp/2012/08/17/3ds-max-file-format-part-1-outer-fil...