Model Details
Model Description
The adapter was trained to recognize and return Director AI camera coordinates consisting of:
- P1–P8: Eight horizontal camera positions around a subject
- E0–E5: Six camera elevation levels
- D1–D3: Three camera distances
The associated ComfyUI custom node converts these coordinates into deterministic, tested instructions for the required image-generation workflow. Exact prompt corrections, profile enforcement, output naming, and workflow metadata are handled by code rather than relying on the language model to calculate them.
- Developed by: Timetocreate7777
- Funded by: Independently developed and self-funded
- Shared by: Timetocreate7777
- Model type: PEFT LoRA adapter for Qwen3.5-4B
- Language: English
- License: Apache-2.0
- Fine-tuned from: unsloth/Qwen3.5-4B
- Framework: Transformers, PEFT, and Unsloth
- ComfyUI custom nodes and Windows installer are included in the Files tab of this repository.
Project Sources
Required Components
This project uses two different LoRAs with separate responsibilities:
1. Director AI interpreter LoRA
The adapter in this repository runs with the unsloth/Qwen3.5-4B base model. It interprets natural requests and returns P–E–D coordinates.
2. Qwen Image Edit Multiple-Angles LoRA
The image-generation workflow requires the separate Qwen Image Edit 2511 Multiple-Angles LoRA used during development and testing. It performs the actual camera-view transformation.
The ordinary Qwen Image Edit model without the required Multiple-Angles LoRA was not used to validate these controls and should not be treated as an equivalent replacement.
Third-party base-model and image-LoRA weights are not included in this repository. Download them from their official sources and follow their respective licenses.
P–E–D Coordinate System
Position
Table with columns: Code, Camera position| Code | Camera position |
|---|
| P1 | Front |
| P2 | Front Right |
| P3 | Right |
| P4 | Back Right |
| P5 | Back |
| P6 | Back Left |
| P7 | Left |
| P8 | Front Left |
Elevation
Table with columns: Code, Camera elevation| Code | Camera elevation |
|---|
| E0 | Extreme Low Angle |
| E1 | Low Angle |
| E2 | Eye Level |
| E3 | Elevated |
| E4 | High Angle |
| E5 | Extreme Elevated View |
E5 is intentionally described as Extreme Elevated View, not a guaranteed 90-degree directly overhead view. Output testing showed that the required image LoRA does not consistently maintain a true vertical overhead position.
Distance
Table with columns: Code, Framing distance| Code | Framing distance |
|---|
| D1 | Close |
| D2 | Medium |
| D3 | Wide |
Example: P3-E3-D2 requests a medium-distance elevated view from the subject's right side.
Intended Uses
Direct Use
This adapter is intended to be loaded by the Director AI ComfyUI custom node for natural-language camera interpretation.
Dropdown mode does not require the interpreter model: P, E, and D selections are compiled deterministically by the workflow. The LoRA is used when the user selects natural-language mode.
Downstream Use
- Director AI P–E–D ComfyUI workflows
- Natural-language camera-view selection
- Camera-coordinate classification
- Prompt-control interfaces built around the same documented coordinate system
Out-of-Scope Uses
- Standalone image generation
- General-purpose chat or instruction following
- Guaranteed physical 3D camera reconstruction
- Exact directly overhead generation
- Replacement for the Multiple-Angles image LoRA
- Autonomous safety-critical decision-making
- Unmodified use with unrelated camera-coordinate systems
Installation and Use
Download the complete repository, then run install_windows.bat.
Do not download only the workflow JSON. The workflow requires the included
ComfyUI-Director-AI-PED custom-node package.
Recommended method
Use the included Director AI installer, custom node, and:
Director_AI_Qwen_image_control.json
The adapter folder must contain at least:
adapter_config.json
adapter_model.safetensors
tokenizer.json
tokenizer_config.json
chat_template.jinja
processor_config.json
Load the adapter with:
Do not rename third-party model files unless the installation documentation specifically requires it. Complete ComfyUI installation instructions and model placement information are supplied with the release package.
Training Details
Training Data
The final E0/E5 upgrade dataset contained:
- 5,142 training conversations
- 240 separate evaluation cases
The dataset retained 3,126 corrected examples from the previously successful training and added balanced coverage for P1–P8, E0–E5, and D1–D3. Examples included coordinate requests, natural-language descriptions, and structured response metadata.
The image model itself was not trained as part of this LoRA. This adapter trains only the Qwen3.5-4B language interpreter.
Training Procedure
- Method: LoRA, 16-bit training
- Epochs: 2
- Batch size: 2
- Gradient accumulation: 4
- Effective batch size: 8
- Context length: 2,048
- Learning rate: 3e-5
- LoRA rank: 16
- LoRA alpha: 16
- LoRA dropout: 0
- Optimizer: AdamW 8-bit
- Scheduler: Linear
- Warmup ratio: 0.05
- Training hardware: NVIDIA GeForce RTX 5090 with approximately 31.84 GiB VRAM
- 19 minutes
Observed final training loss was approximately 0.0343, while evaluation loss stabilized near 0.030.
Evaluation
Evaluation Protocol
The held-out evaluation set contained 240 cases covering P1–P8, E0/E5 upgrade behavior, D1–D3, natural-language requests, and associated workflow metadata.
Results
Table with columns: Measurement, Result| Measurement | Result |
|---|
| Strict full-response score | 205/240 — 85.42% |
| Correct P/E/D coordinates | 238/240 — 99.17% |
| E-coordinate accuracy | 240/240 — 100% |
| D-coordinate accuracy | 240/240 — 100% |
| P-coordinate errors | 2 |
| Metadata-only errors | 33 |
Thirty metadata errors involved incorrect rotation-degree fields and three involved safe-crop flags. These metadata fields are calculated deterministically by the production workflow and are not trusted to the language model. Only two evaluation cases produced incorrect camera coordinates; both involved natural-language right-side interpretation.
Dropdown mode is deterministic and does not depend on language-model interpretation.
Bias, Risks, and Limitations
- Natural-language wording can occasionally produce an adjacent horizontal position.
- Results depend on the downstream image model, source image, seed, LoRA version, and workflow settings.
- The Multiple-Angles image LoRA can drift from strict side views without stronger prompt wording.
- The production node includes hidden strict-profile reinforcement for P3 and P7 across E0–E4.
- E5 produces an extreme elevated view but is not guaranteed to be directly overhead.
- This adapter primarily uses English training examples and has not been comprehensively evaluated in other languages.
- The evaluation measured coordinate interpretation, not aesthetic image quality or safety across all possible content.
Recommendations
- Use the supplied workflow and custom node rather than sending raw coordinate prompts directly.
- Use dropdown mode when exact coordinate selection is more important than natural-language convenience.
- Keep the specified base model and required Multiple-Angles image LoRA unchanged.
- Verify important results visually.
- Follow the licenses and acceptable-use terms of every third-party model used by the workflow.
Environmental Impact
- Hardware: One NVIDIA GeForce RTX 5090
- Training duration: Approximately 19 minutes for the final E0/E5 run
- Cloud provider: None; training was performed locally
- Compute region: Not applicable/local development system
- Estimated carbon emitted: Not measured
Director AI is intended to reduce wasted computation by making usable camera prompts easier to produce and reducing repeated failed generations.
Supporting Continued Development
Director AI is free to try. Optional support can help fund:
- Continued testing and development
- A future Director AI video-control workflow
- Camera-motion and scene-action dropdowns
- Larger and more diverse training datasets
- Additional model support
- Improved installers, documentation, and printable reference cards
- Future camera-native image and video models
SUPPORT OR DONATION LINK: [[ADD LINK OR REMOVE THIS SECTION](https://www.paypal.com/ncp/payment/3JR9PABGZC4GA)]
Feedback
When reporting a problem, please include:
- P–E–D coordinates selected
- Natural-language request, if used
- Source image type
- Expected and actual camera positions
- Seed and relevant workflow settings
- An example result when possible
- Author: Timetocreate7777
- Contact: Use the Community tab of this Hugging Face repository, or add a preferred public contact address here.
Framework Versions
- PEFT 0.18.1
- Transformers-compatible Qwen3.5-4B base model
- Unsloth training environment
Acknowledgements
This project builds on Qwen3.5, Unsloth, Hugging Face Transformers and PEFT, ComfyUI, Qwen Image Edit, and the third-party Multiple-Angles image LoRA. Their respective trademarks, model weights, and licenses remain with their creators.