When I swapped out the NVIDIA RTX A6000 48GB (seen above) for the RTX 4060Ti 16GB (seen below), I rerouted the main motherboard power cable and installed extra hard drives in the bottom power supply enclosure.
At peak, the video card power draw has gone from 300w to 140w. The noise of the 4060Ti’s fans is a little more noticeable during full load, perhaps due to it’s open blowing fan design as opposed to the enclosed blower design of the A6000. And, I’ve re-familiarized myself with the memory optimizing features of A1111 for image generation, which I used to have to make use of with my old RTX 3070 8GB video card that I had before upgrading to the A6000. Later this week, I’ll test out how many LLM layers I can load on to the 4060Ti’s 16GB of VRAM with koboldcpp.
