Porn Dilemma with Boyfriend
	
	
		Okay this is my question.. after some history.
My boyfriend of 2 years  (1 year living together) has always looked at porn, has always been honest with me about it, and we've discussed his porn "habit".  That was the only outlet for his sexuality for years (in a sexless previous marriage; and before that when he was single).  When he moved in with me, I realized that his "browsing" was a bit more than that... he spends hours "collecting" sets of pictures of women, downloading videos, burning them to DVDs, etc.   We've had some arguments about it;  I feel that it DOES take up a lot of his time.. he isn't working, and he spends hours on the computer, tending to his "collection".  He told me "you knew about this from the beginning, etc..".   
The problem that is on my mind now.. is that at first when he moved in.. our sex life was pretty regular, at least a couple of times a week  (I would like more, but he says he has a low sex drive.. or that he is not "agressive" sexually).  NOW... it seems that if I don't initiate sex... it just doesn't happen.  We had a huge blow up about this last week... as I had discovered that AFTER I went to bed.. he spent time on the computer.. looking at porn and masturbating to it.  The fall-out from that discussion was that he said he wasn't feeling "sexual" towards me, because lately he feels that I'm controlling , criticizing, etc.. He was very defensive.. saying that all of that made him not want to have sex with me.  We are very affectionate and he loves to cuddle, kiss, etc... but it doesn't lead anywhere unless I initiate it.  But apparently now, he doesn't feel sexual feelings toward me... and told me to "give it time"...   (I must add, that emotionally we are very close, he is very supportive of me, very sensitive to my OTHER needs).   In other words, every other part of this relationship is good for ME... except this one issue.  But of course it's an important one.
I have to say that I look at porn, too.  In fact he kind of introduced me to it;  but what I thought might happen  (us looking at it together and using it to add something to our sex life) is just not happening.  This seems to be something that he does "in secret"... after I've gone to bed early.  During the day?  He leaves the door to his office open and I come and go... and can see what's on his computer.  He doesn't hide it.  We even talk about it... the fact that he has to "work" on his collection.
So, I'm getting mixed signals here.  Porn is definitely part of his life, he doesn't try to hide it;  BUT... it seems that on nights when I go to bed early... or even nights that I suggest sex.. he makes an excuse  ("I'm not "there" right now..not feeling like it, etc..)  then I go to bed...and he stays up for hours , looking at porn and usually masturbating to it.  BUT he admits it, and in the fight we had last week...he said  "no offense, but it's my penis, I can do what I want".   
I am hurt, resenting this..not really the "porn" part;  but the time he spends on it.  And the way it is seeming to take something away from "us".  Shouldn't he want to have sex with me...even using porn as something to add to our relationship?  I'm very hurt, confused and really not knowing what to think or do.  If I confront him again..is that making me manipulative, criticizing, or even being a "castrating "  which he told me last time?  
All I know, is that when I realized he had done this again, last night.  It made me feel defeated, somehow unattractive  (although he assured me that he doesn't compare me to the women he watches..and he finds me very attractive) ..and just sad.  I dont know what to do.  Just "let it go"...because I DO realize men look at porn and masturbate, just cause they need to "scratch an itch".. or should I sit back and wait and see if our sex DOES improve.  Since the last blow-up...which was emotionally exhausting..I've been very much "business as usual" and have tried to give him his space and time to do what he needs to do.  I am very, very confused as you can tell... I hope this makes sense.  
Any and all comment/opinions will be welcomed here.  Thanks for listening.