betaFeedback

WorksComputer Science

NativeSeg: Native Vision Language Segmentation of 3D Computed Tomography via Spatial Visual Tokens and Verified Local Zoom

Abstract

Text prompted 3D computed tomography (CT) segmentation requires both full slice context and fine boundary precision across volumes where over 80%80\% of organ prompted slices lack the queried target. Existing medical vision language models (VLMs) are largely non native segmenters: they delegate pixel delineation outside the VLM by compressing reasoning into a 1D [SEG] vector for an external Segment Anything Model (SAM) decoder, quantizing masks into lossy discrete codebooks, or issuing box prompts to stateless external SAM tools without empty slice screening or spatial state memory. We introduce NativeSeg, a native vision language segmentation framework on Low Rank Adaptation (LoRA) adapted Qwen3.8-27B that performs dense mask decoding, volumetric triage, spatial error self diagnosis, and multiround local zoom directly over the VLM's 2D spatial visual tokens without external SAM decoders. NativeSeg decodes confidence maps from upper layer 2D spatial tokens fused with a five slice U-Net pathway, halts at zero zooms on >91%>91\% of standalone evaluations via a native presence gate (<pres>), localizes uncertain boundaries via a 20 cell multiscale error gate (<err>), and accepts zoomed updates only when predicted error decreases. Trained solely on adult CT, NativeSeg improves Round 00 DSC by +19.81+19.81 and +7.04+7.04 points over discrete codebook and 1D [SEG] readouts on the identical backbone, reaches 86.81%86.81\% adult and 87.04%87.04\% zero shot pediatric DSC, and safely refines 2D nnU-Net (89.52%89.52\% adult; 86.86%86.86\% pediatric), 3D SegVol (86.81%86.81\%), and 3D VoxTell (89.85%89.85\%).

Paper details

vlnc:W_x8fx9sjh
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
arXiv nonexclusive license
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…