All patients on this study receive the chemotherapy combination of 5-FU, leucovorin and nanoliposomal irinotecan which has shown efficacy in pancreatic cancer (and is FDA approved). In addition, this trial adds immunotherapy (nivolumab) to this chemotherapy regimen to leverage the synergism of chemo-immunotherapy.