When working with a Token, it would be useful to know which Language it came from

[dvclmn]

Token provides a name and range property, but there is currently no way to verify which language configuration is providing which token.

let provider: TokenAttributeProvider = { token in
      
    print("Token: \(token)")

    return switch token.name {
        case let keyword where keyword == "punctuation.delimiter": [.foregroundColor: NSColor.red]
        case let keyword where keyword == "text.title": [.foregroundColor: NSColor.green]
        default: [.foregroundColor: NSColor.blue]
    }
}

[mattmassicotte]

Ok, this is complex. The tokens are delivered are merged across all layers, so the information is lost by this point. Preserving it requires changing how layer cursors work. But I like the idea and its been a problem for me in the past too.