19c: AWS RDS Troubleshooting

Hi Everyone, 

Today one of the product tech lead called me for help with RDS issue that his team is going through. Ideally I would have expected some alert to their slack channel/JIRA ticket automatically, however they did't get any alert but app was crying with some error, that made the team to look at it. When I got that First I checked the DB configuration screen. 

It was saying Master Username as SOAADMIN. I asked for the password to login to the DB. Luckily he had it!!

I started downloading the alert log by using the navigation. Once I reviewed I got some idea. 

ORA-1652: unable to extend temp segment by 128 in tablespace TBS 

2023-02-15T13:29:44.040157-07:00

ORA-1652: unable to extend temp segment by 128 in tablespace TBS 

2023-02-15T13:29:44.049759-07:00

ORA-1652: unable to extend temp segment by 128 in tablespace TBS 

2023-02-15T13:29:44.091735-07:00

ORA-1652: unable to extend temp segment by 128 in tablespace TBS 

2023-02-15T13:29:44.100339-07:00

ORA-1652: unable to extend temp segment by 128 in tablespace TBS 

I login to the DB using SQL Developer, Started checking the DBA tables.

By running the SQL below, it gave the same conclusion.

select * from dba_outstanding_alerts;

When I started adding space, it gave error. 

Error starting at line : 2 in command -

ALTER TABLESPACE tbs add datafile '/rdsdbdata/db/SOADBPD_A/datafile/tbs_datafile_02.dbf' size 100m autoextend on maxsize 30g

Error report -

ORA-04088: error during execution of trigger 'RDSADMIN.RDS_DDL_TRIGGER2'

ORA-00604: error occurred at recursive SQL level 1

ORA-20900: RDS only supports Oracle Managed Files. Check ddl and remove any named identifiers

ORA-06512: at "RDSADMIN.RDSADMIN_TRIGGER_UTIL", line 324

ORA-06512: at line 2

04088. 00000 -  "error during execution of trigger '%s.%s'"

*Cause:    A runtime error occurred during execution of a trigger.

*Action:   Check the triggers which were involved in the operation.

Wooo.. Yes DB has OMF enabled. 

Ran below command and fixed the DB problem. 

alter tablespace TBS add datafile size 100m AUTOEXTEND ON maxsize 30g;

After that I have given information to the product tech lead that DB can be upgraded to latest minor version and can enable enhanced monitoring. 

RDS is cool to have!! RDS custom is better with OS access.!! Will write more on it when things shape on that. Hope this helps someone.