Despite years of self-destructive behaviour, Nick Cave has always enjoyed a singular status. Mick Brown meets one of rock music's most literary songwriters. Article photo available.

'To me the great thing about being 40 is that I don't have to be around young people any more.' Nick Cave lights a cigarette and gives a rueful smile. 'I don't mean that in a snobbish or superior way. But I've always felt kind of old; a little misplaced as a young person.' Once regarded as a hellraiser and enfant terrible, Nick Cave is able to find some consolations in encroaching middle age. Freed of his predilection for addictive substances, he no longer labours under the thankless label of 'the rock star most likely to die next'. His records sell respectably to a loyal audience; his concert performances are nowadays at seated venues, relieving him of the obligation he felt in earlier days to wade into his audience, fists and boots flying.

Singer, songwriter, novelist, sometime playwright and actor, Cave enjoys a singular and peculiar status. As the singer with The Birthday Party, the group which brought him from his native Australia to Europe in the early Eighties, he was regarded as an unruly, insurrectionary force, a personification of the self-destructive impulse to which rock music so often gives licence.

As leader of The Bad Seeds, formed from the remains of The Birthday Party and a few additional members, Cave has established himself as one of the most literary songwriters in rock, producing two of the finest - and most radically contrasting - rock albums of recent times: Murder Ballads, a lubricious collection of tales of mayhem and darkness; and last year's brilliant collection of melancholic love songs, The Boatman's Call.

After his years as a cult figure, these records have elevated Cave precariously close to popular acclaim - not a position that seems to bring him much pleasure. When, in 1996, he was nominated for an MTV Award for Best Male Artist, the nomination was withdrawn at his own request. 'My relationship with my muse is a delicate one at the best of times,' he explained in a letter to the organisers, 'and I feel it's my duty to protect her from influences that may offend her fragile nature. My muse is not a horse and I am in no horse race and, indeed, if she was, still I would not harness her to this tumbrel - this bloody cart of severed heads and glittering prizes. My muse may spook! May bolt! May abandon me completely!'

The preciousness this suggests is misleading. The expression on Cave's face as he runs his big-knuckled fingers through his brilliantined hair is not so much of overweening self-regard as anguished embarrassment. 'I never had any interest in music as a career, and I still stand back aghast at successful things that happen; I still wonder, how the f*** did I manage to do that? Because I still feel very much an imposter in the music world.'

A striking-looking man, Cave folds himself into a sofa like an anglepoise lamp, the gaunt features, waxen complexion and shock of black hair lending him the appearance of some bird of prey, an impression accentuated by his black suit and sweeping black overcoat. Meeting the press is Cave's equivalent of trial by fire. Questions are greeted by him fixing his gaze on the table in front of him, a few moments' careful deliberation, a polite, nervous reply. Whatever he says in interviews, he sighs, never comes out the way he intends it to, and reading them later is excruciating. 'I find that I don't even agree with the things I've said. I'm always having to argue with myself.'

He has just entertained a girl reporter from Japan (Cave has a substantial cult following there) who was unable to speak English, and who read her questions to him from a list provided by her office, staring blankly at his replies before moving on to the next question. It is a mark of Cave's curious standing that while half the people who come to interview him want to talk about drugs, murder and God, the other half want to know whether he slept with Kylie Minogue, with whom he duetted in 1996 on Where the Wild Roses Grow, his first (and only) chart hit. 'That was her last question,' he says with a sigh.

Cave was born and grew up in the small town of Warracknabeal, 180 miles northwest of Melbourne. His mother was a librarian, his father an English and mathematics teacher, who instilled in his son an early awareness of the transforming and talismanic power of literature. 'From the age of 12 or 13, he would read passages to me from books that he thought were good - Dostoevsky, Nabokov,' Cave says. 'But it was less a matter of what I learned from him than seeing what literature did for him. When he talked about literature I saw him become alive.'

In The Flesh Made Word, an autobiographical essay for a Radio 3 religious broadcast, Cave described his father's desk containing 'the beginnings of several aborted novels, all neatly, sadly, filed and titled'. None was ever published. 'Looking back, I can see he was probably a deeply troubled man,' Cave says. 'But as a young person I had no idea a parent could have problems; I always thought they just knew and understood everything. I'm a parent myself now and I realise that's far from the truth. I think one of his problems was that as long as he was dishing out all the excitement, showing me what life was all about, that was fine; but if I turned around and tried to do the same kind of thing he wouldn't have it.'

Cave's father was killed in a car accident in 1978, when Cave was 19. They were never properly reconciled. 'After he died, I very much shut off and ceased to have any real feelings towards him until I had a son myself. Through having a son myself, it clicked that perhaps my father wasn't functioning well.' By his own admission, Cave was a problematic, attention-seeking child. 'I always actively attempted to separate myself from what was generally the mainstream of thought.' His school life followed the typical course of the wilful, artistically inclined outsider - absent from sports and consigned to special classes in the art block - and rock music offered the usual escape route, a place, as Cave puts it, where 'I could make a lot of noise and had a licence to behave as abominably as I wished'.

At art school - which he left after failing his first-year exams - he formed a group, The Boys Next Door, which eventually became The Birthday Party. The role of singer fell to Cave 'because no one else wanted the job, and I couldn't play anything'.

Taking their cue from the burgeoning punk rock scene in Britain and America, The Birthday Party were a succès de scandale. The onstage fisticuffs, skirmishes with the law, the drugs and the alcohol abuse were more or less mandatory. But the calculated outrage of the group's performance and Cave's sustained experiment in self-dereliction were always less interesting than his literacy and obsessions as a writer - a fact which came increasingly to the fore when in 1984 he formed a new group, The Bad Seeds, as a vehicle for his songs, and based himself in Europe.

Cave's narcotic prose has always displayed a mordant preoccupation with violence, revenge and damnation: the fruits of his eclectic literary education and an obsession with Americana - the anguished fatalism of the Delta blues, the American Gothic bloodletting sagas of Cormac McCarthy, the burn-out mythology of Elvis; above all, a judicious reading of that most improbable source of inspiration for the songwriter - the Bible.

Like Dylan and Leonard Cohen, Cave's work has pivoted on the fine line between sacred and profane. Like Cohen, he is one of the few songwriters whose work has merited publication in hard cover - two volumes of King Ink cover his lyrics, prose and plays from 1980 to today - or to have extended his range into fiction. His first novel, And the Ass Saw the Angel (the title comes from the parable of Balaam and his ass), a vivid, hallucinatory story about an inbred hillbilly mute, Euchrid Crow, and Beth, the foundling child of a prostitute who mistakes him for Christ, was published in 1990.

'Nick's writing can be broken into two parts,' says Mick Harvey, founder member of The Birthday Party and The Bad Seeds, and Cave's friend and musical collaborator for the past 26 years. 'In the Eighties you could say he was obsessed with the Old Testament. In the Nineties, he's obsessed with the New Testament. There's the old fire and brimstone Nick, and the newly humanitarian Nick.' Cave would not demur. The shadow of a vengeful, powerful and capricious God, more inclined to punishment than mercy, hangs heavily over his earlier work. 'In those days, it felt like the appropriate text for the way I approached life,' he says, 'which was fuelled by hatred and rage against things. But I don't feel that any more.' The transition can be traced to 1988, when, having spent much of the Eighties living in Berlin in increasingly chaotic circumstances, Cave first underwent treatment for heroin addiction. 'It started to get in the way of my work,' he says simply, 'and that became intolerable. Because my work always came first. I've never been at a point where I've sat around and thought drug-taking is it, and that's the end of it; I've always been working, always writing. And that definitely kept me alive.'

In 1989, at a Bad Seeds concert in the Brazilian city of São Paulo, he met and fell in love with Viviane Carneiro, a fashion stylist. He subsequently moved to the city to be with her. Their son Luke was born in 1991. The couple have now split up, but they remain good friends, living close to each other and sharing the responsibility of bringing up Luke.

Cave now lives alone above a pizza restaurant in west London, in a flat furnished with a piano and bookshelves lined with volumes on his two abiding passions - crime and theology. A settled life. 'I've felt happier in the past four years than I've ever felt before,' he says. 'But, at times, I've also felt unhappier than I've ever felt before. I seem to have a much greater capacity to feel things generally. The circumstances of my life 10 or 15 years ago were horrendous in a lot of ways, but I can't remember actually feeling that unhappy.'

Is that because he can't remember feeling anything? Cave shrugs. 'It has a little bit to do with that, yeah. But it wasn't just about drug-taking; there was just an accelerated pace to my life where I didn't allow things to affect me. I didn't stand still long enough.' On reflection, he says, he was 'too busy to die', although he came close, overdosing on several occasions. 'But I didn't have any real notion or understanding - and I certainly didn't have any fear - about that. And now, at 40, I do have a fairly clear idea that I'm going to die at some point; I wake up with an understanding of that, and that's something that affects the way you live, your relationship with people and with life. But it's not something I think young people should need to understand.' He smiles and reaches for a cigarette. 'It would just ruin a good time.'

'I don't know if Nick is mellower or happier,' says Mick Harvey. 'I still don't get the feeling that he's comfortable with himself, but he never has been. Though I do think he's had some kind of revelation about human nature.' The Boatman's Call was the most eloquent evidence of this, an account of two years in his life, embracing the disintegration of his relationship with Carneiro, and a consoling love affair with the singer P.J. Harvey and its subsequent termination. Few records have spoken with such stark and moving candour about love as a holy sacrament, agency of redemption and instrument of torture.

'I think I've realised the need for humanity; that we need to learn how to forgive each other for things. To reach a sense of compassion towards humanity is not an easy thing; but I feel it's something I need to aspire to. I have faith, and I have doubt. A lot of the time I feel the presence of God quite strongly; and a lot of the time I feel a great absence. But absence or presence, I still believe in Him. I can't believe you just journey through life and then you die.' He shifts uncomfortably in his seat and stares hard at the table. It is a source of some discomfort, he says, that nowadays he is asked to talk about God and morality in much the same way as he was once asked to talk about murder and drugs.

Cave is one of a number of writers invited to contribute an introduction to a series of pocket-sized books of the Bible. He chose the Gospel of Mark. 'My favourite,' he says, his face lighting up with enthusiasm. 'It's the shortest Gospel, the most direct, and the writing is just incredible; Mark's favourite word is "straightway" - straightway they did this, straightway they did that. It just thunders through. To me the figure of Christ is so mysterious, and he says such remarkable things. His struggle is very much about the human struggle, and that's what I find so engrossing. There is no other story like it - not one that I respond to in the same way.' Cave is also putting the finishing touches to a second novel, working on a film soundtrack and writing songs for a forthcoming album. Writing, he says, is 'a form of protection', his way of making sense of the world. 'It makes my own life, which is actually relatively mundane, sparkle in some way. It seems that through my writing I create a world that is larger than life, and perhaps more beautiful and interesting than it actually is.

'But at the same time I'd have to say that music is more important to me than it ever was. It frees me in a certain way. There's a lot of anguish in writing fiction and prose. But the really beautiful thing about music is the ease with which it presents itself. Very often, with songs, it feels like they've just found their way into existence. There's something very mysterious about that.'

He falls silent, thinking on this. 'The other nice thing about music is that you have music that's made by young people for young people, and music that's made for middle-aged people by middle-aged people. I feel that I've very much ceased to make music for young people. It's music made by a 40-year-old man who's accumulated a certain amount of understanding in life.'

He stares at the table and reaches for another cigarette. 'I know that if I'd read this interview when I was 20 I'd have thought, what a complete asshole this guy is, but there you go... '

The Best Of Nick Cave and The Bad Seeds (Mute) is released on May 11