-- Last Updated: Jul-14-11 6:14 PM EST --
I have one of the 1st x-factors and I'm similar to your size. It's super stable and laid out very well. I've toted as much as 50 lbs of gear on it and it hadled it fine. I also got the "gator hatch" for it and paddled with my approx 50lb daughter up front on small lakes and that worked quite well, although a small kid swinging fishing lures around your head is pretty scarey...
There are definately some down sides to it also:
The pronounced keel makes it draw a lot of water.
It turns like a mack truck and takes quite a bit of effort to get it moving. There were also some fairly well reported quality issues on the early models and the companys response left a bad taste in several peoples mouths (mine included). I would think that those issues have been worked out since the I know that they have changed the hull design since I bought mine.
I bought mine with big plans of fishing with it at the beach, but as it turned out, I only put it in the ocean a few times (live 3+ hrs from the coast) and ended up using it mostly on local rivers, which is NOT it's strong suit. I still have it for trips to the beach, but I paddle a canoe for my river fishing.