【しなの】 Shinano Face Tracking Module
- ダウンロード商品¥ 1,200
しなの(v1.02)face trackingモジュール。VRCFaceTracking(VRCFT)ソフトウェアを使用して、様々なface tracking対応VRヘッドセットで動作します。ケモ耳、しっぽ、プルルン瞳のアニメーションもあります！(NOTE) ヘッドセットによってサポートする機能が異なります。Quest Proでのみテストしていました。サポートの問題についてはBoothかTwitterでメッセージしてください！ VRCFT (5.0) Face Tracking module for Shinano (v1.02). Works with various facial tracking VR headsets using VRCFaceTracking (VRCFT) software. It also comes with a lively blink animation, ear and tail movements, modular avatar support, and a few expression activators~! (NOTE) Different headsets support different features. Only tested on Quest Pro. Message me on Booth or Twitter for support or issues. ((Shinano not included (^. ̫ .^) *:･ﾟ☆ )) Please buy here first: https://ponderogen.booth.pm/items/6106863
Prerequisites / 前提条件
【English】 - Shinano (v1.02): https://ponderogen.booth.pm/items/6106863 - Compatible VR headset with face tracking - VRCFT: https://github.com/benaclejames/VRCFaceTracking/releases - (OPTIONAL) Modular avatar: https://modular-avatar.nadena.dev/ 【日本語】 - しなの(v1.02): https://ponderogen.booth.pm/items/6106863 - facial tracking対応VRヘッドセット - VRCFTソフトウェア: https://github.com/benaclejames/VRCFaceTracking/releases - (任意) Modular avatar: https://modular-avatar.nadena.dev/
How to / 使用方法
【English】 1. Make sure the original FBX (Shinano.fbx v1.02) is untouched. 2. Click the "naeruru" tab at the top of Unity and choose "Face Tracking Patcher" 3. Choose Shinano or Shinano_kisekae from dropdown. FBX should prepopulate if fine. 4. Choose "Patch FBX" (choose "Revert FBX" first if you are updating from v1) 5. If successful, you will see "patch completed successfully." 6. Use the provided prefab in Assets/naeruru/Shinano/prefabs or Assets/naeruru/Shinano_kisekae/prefabs NOTE: ft/toggle/GestureAnimLeft & ft/toggle/GestureAnimRight params determine if eye tracking will turn off for a hand gesture (in "Left Hand" and "Right Hand" layers). 1 = turn off eye tracking. 0 = Turn on eye tracking. This means you can uniquely mix hand gestures with face tracking with full control. 【日本語】 1. オリジナルFBXは正しい位置になければなりません。 2. Unity上部の "naeruru"タブをクリックし、"Face Tracking Patcher "を選択します。 3. ShinanoやShinano_kisekaeを選択します（元のFBXがあれば、あらかじめ入力されているはずです）。 4. "Patch FBX"を選択する（v1からアップデートする場合は、まず"Revert FBX"を選択します） 5. サクセスすれば、"patch completed successfully "と表示されます。 6. Assets/naeruru/Shinano/prefabやAssets/naeruru/Shinano_kisekae/prefabにあるPrefabを使用します。 NOTE: ft/toggle/GestureAnimLeftとft/toggle/GestureAnimRightのパラメータは、ハンドジェスチャー（「Left Hand 」レイヤーと 「Right Hand 」レイヤー）に対してアイトラッキングをオフにするかどうかを決定します。1 = アイトラッキングをオフにします。0 = アイトラッキングをオンにします。つまり、ハンドジェスチャーとフェイストラッキングを完全にミックスすることができます。
What's Included / 入れてるもの
- Full Face Tracking setup that works with VRChat and includes all shape keys for ARKit integration - プルルン瞳 ("Live2d" style blink animation) - Expression activated ear and tail movements - extra expressions toggle (adds guruguru to lip suck) - optional modular avatar support - gesture toggle - ear movement toggle - eyelid toggle - mouth tracking toggle Tracked VRChat Expressions: - EyeLeftX/Y - EyeRightX/Y - EyeLidRight/Left - EyeSquintRight/Left - BrowExpressionRight/Left - BrowPinchRight/Left - MouthUpperUp - MouthLowererDown - MouthClosed - MouthTightener - MouthStretch - MouthRaiser - LipPucker - LipSuckUpper/Lower - SmileFrownRight/Left - JawOpen - JawX - MouthX - NoseSneerLeft/Right - CheekPuff/Suck - TongueOut
Updates
※ 9/27/2024: v1.00: - first release! ※ 9/28/2024: v1.1: - add the MouthShrugUpper/Lower shape keys for ARKit ※ 10/2/2024: v1.2: - added a drag and drop version using modular avatar ※ 10/10/2024: v1.3: - added a toggle for eye jiggle ※ 10/10/2024: v1.4: - support shinano v1.02 fbx ※ 11/12/2024: v1.5: - fix issue with Modular Avatar prefab - eyelook now works when mixing expressions ※ 7/6/2025: v1.51: - made a lot of quality of life improvements to the Modular Avatar version of the prefab - fix issue with new versions of Modular Avatar not properly turning off gestures during face tracking - gestures are now always on if you never enable face tracking (they will auto turn off when face tracking is enabled and they are set to off) ※ 7/9/2025: v1.52: - fix issue where eyes would jitter for split second when doing hand gestures (MA prefab)
Common Issues
※ None of the face tracking is working. Only the eyes are moving. - OSC is out of sync for the avatar. Reset OSC in the radial menu. If this does not work, go into "Risky settings" in VRCFT and choose "Reset VRC configs," then switch in and out of the avatar.
Credits / 謝辞
- モデル: https://ponderogen.booth.pm/items/6106863 - VRCFT: https://github.com/benaclejames/VRCFaceTracking - OSCmooth: https://github.com/regzo2/OSCmooth - hdiff patcher: https://github.com/sisong/HDiffPatch