Many of the following artists/albums may not be regarded as (really) weird, but I think they are at least "original":
Kate Bush - "The Dreaming" (Definitely her weirdest album - and my favourite one! I also like the second part of her "Hounds Of Love"-album very much.)
The Bulgarian Voices "Angelite" feat. Huun-Huur-Tu & Sergey Starostin - "Fly, Fly My Sadness" (I think "Legend" is definitely the best song on this album.)
Atrox - "Contentum" (weird vocals), "Terrestrials" (weird vocals and music), "Orgasm" (not as weird as its predecessor, but still very original)
The Third And The Mortal
Anacrusis
Sainkho - "Naked Spirit"
Hulu Project feat. Stepanida - "TranceSiberia"
Mekong Delta - "The Music Of Erich Zann"
Sieges Even - "Steps"
Hedningarna - "Trä", "Hippjokk"
Tactile Gemma
Watchtower - "Control And Resistance"
Voivod - "Killing Technology", "Dimension Hatröss", "Nothingface"
Garmarna - "Guds Spelemän", "Vedergällningen"
Terje Isungset - "Iceman is" (music played by instruments made of ice), "Reise", "Floating Rhythms"
Fear Of God - "Within The Veil" (definitely one of the most original metal albums ever!)
Psychotic Waltz - "A Social Grace", "Into The Everflow"
Egschiglen - "Zazal"
Mari Boine - "Eallin"
Yat-Kha
Primus