imagination XD

converting imagination to reality since 2010


2 Comments

[Unity] Keyed Lipsync using Blendshape + Tagarela

edfedfe

I still research on how to make automated keyless lipsync. So, I found this plug in, it’s free, and it’s easy to use so I got that goin’ for me, which is nice.

Recipe (What you’ll need) :

  • PC with Unity 4.3 or above
  • Tagarela
  • Mesh that has blendshape (If you don’t know how to make blendshape, read this)
  • Blendshape that has at least A,I,U,E,O keys. (if you are too lazy to make E key, you can use I for every E)

Alright let’s start! I’ll use Kagamine Len by Animasa model as example.

  1. After finished download, open it in Unity.
  2. Select an object that has blendshape / skinned mesh renderer on it. Open Component > Tagarela. After that insert Audio Clip and then press Add.lt1
  3. Click Open Editor then press Create New Animation, choose Audio Sync, name it whatever you want, press save.lt2
  4. First, slide the tiny slider near audio’s start, then press + to add new keyframe, locate the new keyframe at the middle of audio, and adjust the blendshape below.
    lt3
  5. I use Unity chan’s konnichiwa (こんにちは私ユニティちゃん). 1 is all Zero, 2 is 100% 001 (O (I forgot to change name), 3 is also zero because it’s closing its mouth when saying kon’, and 4 is 100% i, when it says ni.
    lt4
  6. Set it till near perfection. Also remember to set keyframe to zero on all flat audio which is mute (does your mouth open when you say nothing ? unless you breathing with mouth, like me). For example, your voice was “Hello World”, 1 all zero keyframe was located before Hello, 2 keyframe was located in ‘He’ has 100% ‘E’, and 3 keyframe was located in the ‘llo” has 100% ‘O’ and 0% ‘E’, at the end of ‘Hello’ add 4 keyframe that is zero keyframe, and 5 keyframe was located at the beginning of ‘World’ which also zero. 6 keyframe repat like 2 keyframe but with different value.
    lt5
  7. After you done naturalising the lipsync, always remember to put zero keyframe at the start of audio not voice. and then save it. You may ask how to use it on gameplay, well, you’ll only need to put this GetComponent<Tagarela>().Play( <Your animation number (mine is 0 because it’s the first animation)> ); on a C# script. Also attach this script on the same place where your blendshape mesh.
    lt6
  8. Ta-da… Not bad I see. I also forgot to add some Mecanim animator, so it looks like stupid people says “Hello, I’m Unity-chan” but actually you are Len Kagamine.

Next, I’ll research much easier to use lipsync or Anime-like lipsync. Most anime I watch, they only use 1 key. Even they say “What the hell are you doing”, their mouth will be always open and close only, no wide or narrow. Also remember to make it jagged, so it’ll look like Anime. I also researching on how to combine cloth shader with Toon shader like cloth crumple shadow in usual anime.

Ah and Imagine-chan’s model has finished, and it’ll release probably this november. I think I’ll need to remodel, because her head looks ridiculous. However, morphless FBX and PMX download will be available. I’m kinda busy working. My supervisor wont let me to do this, so that’s why I wont upload this model soon.


Leave a comment

[Unity] Taking In-Game Screenshot

Hello, everyone, Sorry I didn’t post something here in long time. I’m very busy, leveling up my CG skills. I also post some random unity things.

So, basically, taking screenshot in Unity is very easy. Copy this script below, and attach it in Main Camera

var folderName : String = "DCIM";
var captureSound : AudioClip;
var quality : float; //Set screenshot resolutions, default is 1. 1 equals your monitor size.
private var screenshotFader : GameObject;

function LateUpdate(){
 if(screenshotFader){ //Flashing effect
 screenshotFader.guiTexture.color.a -= Time.deltaTime;
 if(screenshotFader.guiTexture.color.a < 0){
 Destroy(screenshotFader);
 screenshotFader = null;
 }
 }
 
 if(Input.GetKeyDown("C") && !screenshotFader){
 if (!System.IO.Directory.Exists(folderName)) System.IO.Directory.CreateDirectory(folderName);
 
 screenshotFilename = folderName+"/DSC_"+System.DateTime.Now.Day.ToString()+"_"+System.DateTime.Now.Hour.ToString()+System.DateTime.Now.Minute.ToString()+System.DateTime.Now.Second.ToString()+".png";
 if(!System.IO.File.Exists(screenshotFilename)){
 Application.CaptureScreenshot(screenshotFilename,quality);
 AudioSource.PlayClipAtPoint(captureSound,transform.position);
 DrawWhiteItem();
 }
 }
}

function DrawWhiteItem(){
 yield new WaitForSeconds(0.5); //wait for a few frames so the application can capture before the white flash comes out.
 screenshotFader = DrawFader();
}

static function DrawFader() : GameObject{
 var fdt = new Texture2D(1,1);
 fdt.SetPixel(0,0,Color.white);
 fdt.Apply();
 
 var fadex = new GameObject("CSader");
 fadex.AddComponent(GUITexture);
 fadex.transform.position = Vector3(.5,.5,1000);
 fadex.guiTexture.texture = fdt;
 
 return fadex;
}

now it’ll save the screenshot on your game root folder / DCIM (you can change the folder name).


2 Comments

Joint-based Hair / Cloth Physics for Unity

I was doing the MMD4Unity research. I do this because, on Google, if you want a Hair Physics, you have to wrote a script, or key frame it naturally in your model. Ain’t nobody got time for that keyframing! So, this might be very useful for easy Joint-based hair / cloth physics, even wrote a script was useful too.

Okay, so it’ll be like this. It could be very awesomely epic if you are not lazy to set the character joint setting.

“It’s long and complicated, i better use keyframe method.” Yeah true, but what to do when the hair colliding object because of your keyframing method ?

Let’s get Neru Akita as example (Model from MMD, some motion from Unity-chan).

Unity 2014-07-27 14-07-06-60_2

1. Now Select cloth / hair bones and then add Capsule Collider like the picture below.
1(bones)

2. After that, adjust the size of the colliders and then add Character Joint.
2(bones)

3. If your character has a Character Controller on it / Playable, Open Tags & Layer, add 2 layers. Set ‘Player’ layer to object that has Character Controller on it. Else, set the object that you want to have a hair / cloth physics like Hair Bones1, Hair Bones2, and so on, or Hair/Cloth physics collider like MidSpine (That has Collider, so hair / cloth wont clip like hell). Basically, Just set Cloth Layer to Skinned Mesh Renderer, and set it to all children.
3b (Bones)

4. Go to your character controller script. Whatever script is OK as long as its located on Object that has Character Controller on it. Don’t make a new script. Just add this line to function Start() or void Start(). Works on both C# and JS. 8 is Cloth layer, 9 is Player layer. it’s all up to you on what layer you set the Cloth or Player layer. If you set cloth layer to 10, then write 10.

Physics.IgnoreLayerCollision(8,9);

3c (bones)
5. Alright now let’s add Rigidbody on cloth’s / hair’s root bone. For the root of the cloth (like this below), turn on isKinematic and turn off useGravity. Root doesn’t need a Character Joint, Collider is optional.

4 (bones)
6. Now set the Character Joint’s connected body. For instance, 1 (Cloth Root), 2 (1’s child), 3 (2’s child). 3’s connected body is 2, 2’s connected body is 1, and 1 doesn’t have a Character Joint. Like the picture below.
5 (bones)
7. Set bone’s swing limit, spring, high twist limit, low twist limit that suits to your model.
6 (bones)
8. Now add some collider to body that Hair or cloth will collide. Remember to set the body layer to CLOTH, so your character controller wont collide it. I add the colliders on Body, Hands, and Head.
7 (bones)

Because if you don’t add colliders, it’ll look like this:
Unity 2014-07-27 14-07-06-60

Now look! A cloths dynamic! It much better than the method I use on Wild West Showdown (Skinned Cloth). Look at her front hair and tie.
Unity 2014-07-27 14-07-06-60_1

 

As I said, I leave making games because I need to level up my CG level. I said I was give up right ? No, and never. I just need to learn to make a better CG Artwork. I’m currently making a mascot model for Imagination, named Imajine-chan. but, I don’t have an inspiration for her character design.

If you have something to ask, don’t hesitate to comment, I’ll reply it fast.

EDIT : “My Character raycast’s script is broken because of this.” Well, you could replace Cloth to IgnoreRaycast layer.


Leave a comment

Random Rant About Copyright

NOTE : I’m kinda off for a while. You maybe wont see any research for a while. I’ll be back on August or September, I’m kinda busy on upgrading my CG Level. Sorry about that.

I already had this problem since 2009, and real hate with all those copyrights. The creator of copyright is just like they want an infinite money. I seriously don’t care about copyright.

Remember that day, October 31 2013, my game Nitro Racer XD Full Version was shared freely in the universe by VACE ? Do I really care about it ? I don’t even got a penny from making this game, and my game was shared in the universe, but I ain’t even mad. If you were the creator of Nitro Racer XD, you would kill all of them. I just like “Meh, if they pirated my game, that means my game was nice.” Okay, let’s return to the topic.

So, how can I say that if Copyright is a Creativity Killer. Look, if you are a famous singer, you made a song, and then someone cover your song and said “I do not own this song, all copyright goes to <your name>”, but you still insist to kill / block them, then you’re a total a****le for blocking them.

I feel sad for my client that already made more than 10 fan videos for famous singer as tribute on YouTube. They made it really nice and good, they even always bought original CD and souvenirs. And you know what ? Sorry this video has been copyrighted by “Copyright-thirsty company”. That’s such a waste of time, energy, and internet (it’s a struggle to upload 300MB with slow internet).

Back then, when I was dumb, I made a remix of Canon song and it was blocked by SoundCloud or YouTube. Does that mean Johann Pachelbel going to sue me ? After that incident, I started to compose my own song, even it’s bad as hell.

Because of this, I’m concerned to make A Certain Musical Vocaloid 3D Animation Experiment. Will it be banned by YouTube because I make a crossover video of Vocaloid and To aru Universe ? It such a waste of time if it was banned.

I heard that if you craft a costume of your favorite character, you’ll be executed (copyright) so you have to buy official licensed costume. Licensed costume be like $30,000 and handmade costume only $10 comes with creativity.

If copyright gone crazy, this world’ll be like :

  • You are NOT allowed to craft an action figure from Pencil, Wood, or anything craftable.
  • You are NOT allowed to make a fan art, fan video, tributes to the artist, music cover, or something like that even you wrote their name as big as hell.
  • You are NOT allowed to share anything to your friend. ex: if you want your friend to listen to some music, they have to buy it first.
  • You are NOT allowed to print your favorite poster that you got from internet.
  • You are NOT allowed to tell a news that you read on the internet to your friend. Because your friend have to read it from original source.
  • You are NOT allowed to watch TV together. ONE TV FOR ONE PEOPLE!
  • You are NOT allowed to give a newspaper that you already read to other person. One newspaper only for one people (just like One Antivirus only for one PC).
  • You are NOT allowed to give a charity things, because Poor people have to buy Licensed one.
  • You are NOT allowed to copy someone’s quote / lyrics as your status or anything even you write their name.
  • All drawings be like, “ORIGINAL CHARACTER DO NOT COPY”. There’ll be no fan arts anymore, or “Character X in my style”
  • Every images on the internet will be blank because they afraid you’ll copy it and share it.
  • There’ll be no “Tweet” or “Share” button.
  • “1,000 years of dungeon!” Why ? “Because he shared a file!”
  • Every people in Earth will be dumb as hell because they are not allowed to use their creativity (I’ve seen so many fan crafts on 9GAG, such as Pencil Craft Adventure Time, or famous artist statue made from glass. That thing will probably blocked if Copyrights gone wild) , and they also depends on copyright makers.
  • If it become more crazier, One Software License only for ONE PERSON. That’s mean you are NOT allowed to let your friend use it.
  • Ah so many, it makes me puke copyrights.

 

Conclusion

Copyright can be accepted as long as it respects other’s creativity too. Fans just want to give you an appreciation, that’s why they made a Fan art, Fan video, or Fan music cover. Don’t be such a d***, Fan arts wont kill you. I’d be very thankful if only I have a fan art, remixed song, or even my works posted on other website.

Some people aren’t just rich as you, so don’t insist poor people to buy $10,000 item just because you don’t want they use a replicated one / handmade. I much like creative commons than all rights reserved s***.

Note : My game or artwork doesn’t have any copyright (I guess mine is Creative Commons), so you may spread it to the universe if you want. As long as people doesn’t misunderstood me (people wont believe if I’m the creator of that thing).


Leave a comment

[Personal] Miserable Life

First of all, I’m sorry for posting something long and personal here, but I feel very miserable, I couldn’t continue on some researches. The purpose I wrote this is, when all my mission / dreams accomplish, I can look how I deal so many difficult times.

This is how I feel right now. It’s like I’m 500 parsecs away to my dream.

I’m unemployed

It has been 2 months my school life has ended. 40% of my classmates already got a job. It makes me concern about “Will I get a job soon ?” Everyday I’m looking for the newspaper, they all hiring a job that I can’t do. It’s really hard to find a job that I have a skill on it, like After Effect, Cinema 4D, Unity, or even Photoshop. Finding a Digital job in Traditional country is just like finding gold fish in Ocean.

Last week, I tried to send an application letter to some bridal company for photo editor position, but I think I had no luck with it. Just because I don’t have Diploma, Doesn’t mean I can’t do it. All of them seems underestimate me.

This one thing I really hate is, when I was in school, everyone wants me to work at their company, but when I finally graduated, No one wants me anymore. I just feel that I’m not worthy sitting in front of computer all time feeling miserable.

Am I fated to always fail on everything, not getting a job, and always unfortunate ? I hate the word ‘fate’. It makes people think everything is impossible just because fate don’t let them.

All my ‘friends’ are ready to laugh at me because I’m still don’t get a job. But it’s not a problem for me. Go ahead! Laugh me as loud as you want. I have no feelings after all…

About my research

I’ve been offline for so long huh ? yeah I’m sorry I didn’t post Unity research anymore. I’m very busy upgrading my AE and 3D Modelling skills. I always think that making games just not worth. But however, I’m still going to make it. The main reason I cancel Personified Fear, Crystal Guardians, and London Traffic Jam is the artwork is poor, so I need to upgrade my Modelling skill.

I was just kidding about I’m quitting making games. I have a dream to make Imagination (game and animation studio) happen. It’s a read-only dream, so if someone gonna make me down, it’s not gonna change even I said I’m very down and miserable. Everytime I listen to fripSide’s Level 5 and Future Gazer music, it gains my spirit back.

I’LL REACH THE NEXT STAGE TO REALIZE ALL!

Ending

Even I feel really miserable (I always think to kill myself), I’ll still continue making everything. I have so many projects, from Project “Magic of Effect” to Project Sequence (my first anime with Unity / visual novel). So I wish I could done everything without tons of failure anymore (yeah if I could release 1 game successfully, that’d be great!). I know that success always come from failure.

Thanks for reading! Have a great week!

This motivates me


Leave a comment

[Shader] Reflective Transparent / Water-like Unity Indie

This is what I promised. Sorry for being late, I’m kinda busy recently. I made this shader by merging between Transparent>Diffuse and Reflective>Diffuse. But I haven’t done with Normal Mapped Specular. My Unity kinda hates me, everytime I add Normal Map to this shader Unity Yells “Too many texture interpolators would be used for ForwardBase pass!” or “_ReflectColor no Properties!”. Perhaps you can do it yourself.

NOTE : I didn’t copy this script from internet. I just merge Unity’s Transparent>Diffuse and Reflective>Diffuse. So, if you are saying that I copy your script like that movie script I was made in 2012 and you found in 2014, go f*** yourself… By the way, this script ALREADY Exist on Nitro Racer XD on Epic Living Room track. I just made a lot of modification from Nitro Racer XD.

Shader name in Unity is “Glass Reflective_N”, and this is the preview / how to use the shader.

Ref_BLWater Ref_Full Ref_BLRef Ref_MStUnity - Untitled - RT - PC, Mac & Linux Standalone_4

Want More Realistic ?

If you want more realistic, you could add UVMover (Moving main texture’s offset from script * Time.deltaTime), and Realtime Reflection INDIE. Adding some Caustic effects or Underwater effects or Normal Map or Specular Shininess. You can also use this shader for a glass…

Glass Reflective_N

Shader name is a little bit ironic isn’t it ? It says N for Normal Map support, but this shader couldn’t support Normal Map. Alright here’s the shader.

Shader "Glass Reflective_N" {
 Properties {
 _Color ("Main Color", Color) = (0.5,0.5,0.5,1)
 _ReflectColor ("Reflection Color", Color) = (1,1,1,0.5)
 //_Shininess ("Shininess", Range (0.01, 1)) = 0.078125
 _MainTex ("Base (RGB) TransGloss (A)", 2D) = "white" {}
 //_BumpMap ("Normalmap", 2D) = "bump" {}
 _Cube ("Reflection Cubemap", Cube) = "black" { TexGen CubeReflect }
 }
 SubShader {
 Tags {"Queue"="Transparent" "IgnoreProjector"="True" "RenderType"="Transparent"}
 Blend SrcAlpha OneMinusSrcAlpha
 //Pass {
 // Color [_Color]
 // SetTexture [_MainTex] {
 // combine texture * primary
 // }
 // }
 LOD 300
 
 CGPROGRAM
 //#pragma surface surf BlinnPhong decal:add nolightmap
 #pragma surface surf BlinnPhong alpha
 //#pragma target 3.0
 sampler2D _MainTex;
 //sampler2D _BumpMap;
 samplerCUBE _Cube;
 //half _Shininess;
 
 fixed4 _ReflectColor;
 fixed4 _Color;
 
 struct Input {
 float3 worldRefl;
 float2 uv_MainTex;
 //float2 uv_BumpMap;
 INTERNAL_DATA
 };
 
 void surf (Input IN, inout SurfaceOutput o) {
 fixed4 tex = tex2D(_MainTex, IN.uv_MainTex);
 //o.Albedo = 1;
 //o.Gloss = 0;
 o.Albedo = tex.rgb * _Color.rgb;
 o.Gloss = tex.a;
 //o.Normal = UnpackNormal (tex2D (_BumpMap, IN.uv_BumpMap));
 
 //o.Specular = _Shininess;
 float3 worldRefl = WorldReflectionVector (IN, o.Normal);
 fixed4 reflcol = texCUBE (_Cube, IN.worldRefl);
 reflcol *= tex.a;
 o.Emission = reflcol.rgb * _ReflectColor.rgb;
 //o.Alpha = reflcol.a * _ReflectColor.a;
 o.Alpha = tex.a * _Color.a;
 
 }
 ENDCG
 }
 FallBack "Transparent/VertexLit"
}

 


Leave a comment

School life ends today

First of all, I’m sorry that I post a long personal post here.

So, yeah. I finally fought final boss today. The final boss was really tough, it has 160 parts (different questions). Should I be happy or sad ?

We had so many adventures

I don’t really have so many adventures, because I’m not allowed to go outside house. I rather had so much fun in school. Me and my friends did something crazy even my bro said that we’re like jackass. We slide through ceramics with school uniform, we took a picture in every room including toilets and principal offices, we ride a shopping cart in a mall’s parking lot (launch from top level to bottom), and many more.

We had so many fights

In March, I had so many relation fight with my friend just because I refused to do their homework and they also liked to ignore me making me like talking to a wall or sometimes acted that I’m invisible. That made me hated them. I thought this fight will lasts forever, but not. I’m glad this fight over in April. In April, me and all my classmates were like “All Together Now”. No more fights… 

The end of school life / The end of the line

I feel really ancient. I didn’t realize times goes really fast. It has been over 12 years in this school. I had so many awesome memories (I already made a 17 minutes school video named ‘PROJECT-CLARITY’). Listening to Secret Base really makes me cry. So, what to do after school life ?

Everyone seems so caring me

Everyone asked me, “What you do after school life ends ?”, “What college you’ll attend ?”, “What’s your dream job ?”. The answer is I don’t know! Every that information is secret, my top secret. Why ? Because if I can’t do that, I’m sure you’ll laugh at me and make me as a joke. This special question “Who do you’ll marry ?” is also same, I don’t know, and I don’t care if I’d get married or not. My teacher also like to ask me this “Why you don’t want to marry ?”, the answer is I still don’t know about that. I could only buy Uiharu pillow. However, my parent will still insist me. Besides, who’d like a heavy geek / nerd with dyslexia anyway ? 

So what I do next ?

All my friends went to college, I probably don’t go to college, because I don’t have money, and there also no Animation school. In June 2014, I probably start working in printing company and become a young adult (that’s sad, I’m not classified as High School Game Dev anymore). I probably life with infinite loop principal (Eat – Sleep – Anime <- Return). 

But before that, till now, I still had some social problem. The problem is, I can’t talk to other people like other people do. I always feel nervous, lost all my mind and stutter when talking even worst, I changed the order (like “How, Hi are you?”). This probably I’m too shy. I need to fix this problem soon.

All the skills I have from Photoshop to After Effects, seems useless here. But however, I wont give up. Everything I said I’ll give up on Game Deving and Animating is just a joke. I’m very ambitious, I do whatever it takes to reach my dream. Now I have so much time to experimenting with Unity, After Effect, and C4D. 

So, even I’m not a high school student anymore, there’ll still a lot project will going on (From PROJECT LEVEL UP to PROJECT SEQUENCE). Wish me luck…

In The End

Dear My Friend, Even we’re separated with a long distances, I hope we all be happy!
I believe that we’ll met in August 10 years later.
The Best Memories.
-[CLARITY]-
2013/2014
IMG_20140416_151528 IMG_20140416_151502
The picture was taken with iPhone 5. Geez, what a really hi tech phone…
Follow

Get every new post delivered to your Inbox.

Join 713 other followers