Fundraising/Team processes/DRI/Chores

Following up on incoming failmail

• Update the Failmail zoo if it's something common
• File phab tasks with details of what we need to do so it stops failmailing.
• Email team letting them know it's been documented

Follow up or ack incoming alerts (from payments team or processors) to fr-tech@ mailbox

• reply failmail or slack related party

Checking damaged messages

https://civicrm.wikimedia.org/civicrm/damaged

• In CiviCRM, go to /damaged
• Look at the stuff from this week
• If the error looks like a database lock, please requeue the message
• If it's a new type of failure, please create a phab ticket

Check data analyst board to see if anything from upstream down

• use https://frmon.wikimedia.org/d/xbcwsjY4k/payment-transaction-outcomes to check fraud count for each payment methods
• use https://frmon.wikimedia.org/d/jgm2l4x/payment-transaction-failure-big-board to check success rate based on payment method

Log checking

On our centralized logging box, scan through the error logs from today

• Create phab tasks for any errors that are unexpected/new
• (errors generally should not be expected)
• use https://github.com/jackgleeson/binscripts/blob/master/logdog.sh in frlog1002 to export log as a file to share in phab ticket
• use https://civicrm.wikimedia.org/civicrm/fraud-monitor to monitor any fraud pattern, if any add to frpm1002 filter them out
• use https://civicrm.wikimedia.org/civicrm/fraud-velocity to check if the filter can be removed, like the fraud attack stoped

Deployments

• CentralNotice (not for long)
• CiviCRM
• Payments-wiki
• SmashPig

Check on audit incoming directories

• If they are getting really full, figure out why
• Either move out stuck files or run in --make-missing mode

Every 90 days should login to test consoles for all payment gateways to prevent lock account

We have accounts that log us out after a certain amount of inactivity, log into them when you join and leave rotation.

• adyen
• gravy
• braintree
• dlocal
• Chariot
• checkout.com
• acoustic
• ach